arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.14741eess.AScs.SD
收藏

重新思考会话变异性:在说话人验证中利用会话嵌入提升会话鲁棒性

Rethinking Session Variability: Leveraging Session Embeddings for Session Robustness in Speaker Verification

NAVER Cloud Corporation(NAVER云公司);Korea Advanced Institute of Science and Technology(韩国科学技术院)

Hee-Soo Heo, KiHyun Nam, Bong-Jin Lee, Youngki Kwon, Minjae Lee, You Jin Kim, Joon Son Chung

AI总结:

针对说话人验证中的会话/信道变异问题,本文在固定说话人嵌入提取器上训练辅助会话嵌入网络,并用会话相似度补偿说话人分数,在不重训提取器的情况下提升鲁棒性。

摘要:

在说话人验证领域,会话或信道变异性构成了一项重大挑战。尽管许多当代方法旨在将会话信息与说话人嵌入分离,我们提出了一种新方法:使用额外的嵌入来表示会话信息。该方法通过训练一个附加到说话人嵌入提取器上的辅助网络实现,而提取器在此训练过程中保持固定。这会产生两个相似度分数:一个用于说话人信息,另一个用于会话信息。后一个分数作为前一个分数的补偿,因为前者可能因会话变异而发生偏斜。我们的大量实验表明,无需重新训练嵌入提取器,即可有效补偿会话信息。

英文摘要:

In the field of speaker verification, session or channel variability poses a significant challenge. While many contemporary methods aim to disentangle session information from speaker embeddings, we introduce a novel approach using an additional embedding to represent the session information. This is achieved by training an auxiliary network appended to the speaker embedding extractor which remains fixed in this training process. This results in two similarity scores: one for the speakers information and one for the session information. The latter score acts as a compensator for the former that might be skewed due to session variations. Our extensive experiments demonstrate that session information can be effectively compensated without retraining of the embedding extractor.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑