DyShip:利用声学特征从双人对话中分类说话人关系
Dyship: Leveraging Acoustic Features For Speaker Relationship Classification From Dyadic Conversations
Kieran Sturges, Thomas Thebaud, Yaohan Guan, Najim Dehak
AI 速读 基于摘要
该论文提出 DyShip 框架,在 Seamless Interaction 语料库上比较五种语音表示,用于从双人对话中判断说话人之间的熟悉程度与亲属关系。
cs.CL · cs.AI
查看原文摘要
We introduce DyShip, a framework for classifying speaker familiarity and kinship from dyadic conversations in the Seamless Interaction corpus. We compare five speech representations: spectrograms, MFCCs, self-supervised WavLM representations, x-vectors, and estimated articulatory movements. Spectral features perform best for familiarity classification, reaching an accuracy of 87.81%, while WavLM achieves the highest kinship accuracy of 85.17%. X-vectors and articulatory features yield weaker results on familiarity classifiaction, but shine for kinship classification, with an AUC of 0.909 for x-vectors. Most classifiers exceed previously reported human and audio language model scores on the same dataset. These findings highlight the potential of conventional acoustic features for relationship inference and motivate further investigation of the conversational cues captured by different representations.