arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.06208cs.SDeess.AS
收藏

量化言语病理对自动与人工说话人验证的影响

Quantifying the effect of speech pathology on automatic and human speaker verification

Nagoya University(名古屋大学);Netherlands Cancer Institute(荷兰癌症研究所);University of Groningen(格罗宁根大学);University Medical Center Groningen(格罗宁根大学医学中心)

Bence Mark Halpern, Thomas Tienkamp, Wen-Chin Huang, Lester Phillip Violeta, Teja Rebernik, Sebastiaan de Visscher, Max Witjes, Martijn Wieling, Defne Abur, Tomoki Toda

AI总结:

该研究利用两个荷兰语口腔癌手术前后配对语音数据集,量化言语病理对自动说话人验证的负面影响,并结合感知实验比较机器与人类判断的异同。

摘要:

本研究探讨了针对言语病理的外科干预(具体为口腔癌手术所致)如何影响自动说话人验证(ASV)系统的性能。利用两个近期采集的荷兰语数据集 NKI-OC-VC 和 SPOKE,其中包含同一说话人手术前后的配对音频,我们评估了言语病理对 ASV 性能的影响程度,以及言语严重程度的客观/主观指标是否与性能相关。最后,我们开展了一项感知研究,以比较 ASV 与人类听者的判断。我们的发现表明,病理言语会对 ASV 性能产生负面影响,且言语严重程度与性能呈负相关。在说话人相似度和严重程度的感知评分与客观评分之间存在中等程度的一致性;然而,在感知研究中,我们无法明确证实同样的现象是否也存在于人类感知中。

英文摘要:

This study investigates how surgical intervention for speech pathology (specifically, as a result of oral cancer surgery) impacts the performance of an automatic speaker verification (ASV) system. Using two recently collected Dutch datasets with parallel pre and post-surgery audio from the same speaker, NKI-OC-VC and SPOKE, we assess the extent to which speech pathology influences ASV performance, and whether objective/subjective measures of speech severity are correlated with the performance. Finally, we carry out a perceptual study to compare judgements of ASV and human listeners. Our findings reveal that pathological speech negatively affects ASV performance, and the severity of the speech is negatively correlated with the performance. There is a moderate agreement in perceptual and objective scores of speaker similarity and severity, however, we could not clearly establish in the perceptual study, whether the same phenomenon also exists in human perception.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑