eDIAR:基于e-means的无训练开放说话人流式日志化,适用于长会议与大型档案
eDIAR: Training-Free Open-Speaker Streaming Diarization for Long Meetings and Large Archives via e-means
Kyudan Jung, Jihwan Kim, Minwoo Lee, Eunji Shin, Jaegul Choo
AI 速读 基于摘要
作者提出eDIAR,利用e-means聚类在固定槽位神经日志化器上实现无训练、无说话人数上限的流式说话人日志化,并支持大型档案的逐帧说话人链接。
cs.SD
查看原文摘要
Meetings last up to an hour, and nobody knows in advance how many people will speak. Neural diarizers with a fixed number of output slots, such as Streaming Sortformer and Nemotron-3, are accurate and run online, but they cannot name more speakers than they have slots. We remove this limit without retraining. The slot head keeps deciding who is active and when speech overlaps, and speaker embeddings are clustered inside a single slot, with the official e-means algorithm, only after every slot has been used. In the streaming system, re-clustering is confined to a bounded window, labels are revised for a few seconds, and identities are anchored to the slots of the head. The resulting system has no limit on the number of speakers and stays accurate when speakers outnumber the slots, where fixed-slot models break down. On meetings that grow to an hour it stays far more accurate than Streaming Sortformer, which accumulates errors, and its cost per update does not grow with the meeting. The same recipe turns the four-slot Streaming Sortformer into an open-speaker system. Across recordings, e-means makes it affordable to link the speakers of a large archive frame by frame, a task that arises when conversational corpora are prepared, and it reaches the clustering quality of Lloyd's $k$-means several times faster. The method needs little tuning, and e-means runs with its default recipe from a few hundred to more than a million embeddings.