Quantifying the effect of speech pathology on automatic and human speaker verification
Nagoya University(名古屋大学);Netherlands Cancer Institute(荷兰癌症研究所);University of Groningen(格罗宁根大学);University Medical Center Groningen(格罗宁根大学医学中心)
Bence Mark Halpern, Thomas Tienkamp, Wen-Chin Huang, Lester Phillip Violeta, Teja Rebernik, Sebastiaan de Visscher, Max Witjes, Martijn Wieling, Defne Abur, Tomoki Toda
本研究探讨了针对言语病理的外科干预(具体为口腔癌手术所致)如何影响自动说话人验证(ASV)系统的性能。利用两个近期采集的荷兰语数据集 NKI-OC-VC 和 SPOKE,其中包含同一说话人手术前后的配对音频,我们评估了言语病理对 ASV 性能的影响程度,以及言语严重程度的客观/主观指标是否与性能相关。最后,我们开展了一项感知研究,以比较 ASV 与人类听者的判断。我们的发现表明,病理言语会对 ASV 性能产生负面影响,且言语严重程度与性能呈负相关。在说话人相似度和严重程度的感知评分与客观评分之间存在中等程度的一致性;然而,在感知研究中,我们无法明确证实同样的现象是否也存在于人类感知中。
英文摘要:
This study investigates how surgical intervention for speech pathology (specifically, as a result of oral cancer surgery) impacts the performance of an automatic speaker verification (ASV) system. Using two recently collected Dutch datasets with parallel pre and post-surgery audio from the same speaker, NKI-OC-VC and SPOKE, we assess the extent to which speech pathology influences ASV performance, and whether objective/subjective measures of speech severity are correlated with the performance. Finally, we carry out a perceptual study to compare judgements of ASV and human listeners. Our findings reveal that pathological speech negatively affects ASV performance, and the severity of the speech is negatively correlated with the performance. There is a moderate agreement in perceptual and objective scores of speaker similarity and severity, however, we could not clearly establish in the perceptual study, whether the same phenomenon also exists in human perception.
Triplet loss based embeddings for forensic speaker identification in Spanish
Facultad de Estudios Superiores Cuautitlán(库奥蒂特兰高等研究学院);Universidad Nacional Autónoma de México(墨西哥国立自治大学);Universidad Abierta y a Distancia de México(墨西哥开放与远程大学);University of Malta(马耳他大学)
Controllable Dysarthric Speech Synthesis with Patient-Specific Conditioning for Speaker-Diverse ASR Augmentation
Department of Language Science and Technology, The Hong Kong Polytechnic University(语言科学与技术系,香港理工大学);College of Rehabilitation Medicine, Fujian University of Traditional Chinese Medicine(康复医学学院,福建中医药大学);Department of Imaging, Rehabilitation Hospital affiliated to Fujian University of Traditional Chinese Medicine(影像科,福建中医药大学附属康复医院)
Speaker-Disentangled Remote Speech Detection of Asthma and COPD Exacerbations
Institute of Data Science, Maastricht University(数据科学研究所,马斯特里赫特大学);NUTRIM Research Institute of Nutrition and Translational Research in Metabolism, Faculty of Health Medicine and Life Sciences, Maastricht University(营养与代谢转化研究营养研究所,健康医学与生命科学学院,马斯特里赫特大学);Maastricht University Medical Centre(马斯特里赫特大学医学中心)
Pathological voice adaptation with autoencoder-based voice conversion
Delft University of Technology(代尔夫特理工大学);Universitat Politecnica de Catalunya(加泰罗尼亚理工大学);University of Amsterdam(阿姆斯特丹大学);Netherlands Cancer Institute(荷兰癌症研究所);Johns Hopkins University(约翰斯·霍普金斯大学)
The Voice Behind the Words: Quantifying Intersectional Bias in SpeechLLMs
1 Department of Speech, Music;Hearing, KTH Royal Institute of Technology, Sweden 2 Centre for Speech Technology Research, University of Edinburgh, UK 3 Texas A\&M University, USA
Quantifying the Uncertainty of Blindly Estimated Room Embeddings Using a Dispersion-Calibrated Score
Centre for Vision Speech and Signal Processing, University of Surrey(萨里大学视觉、语音与信号处理中心);International Audio Laboratories Erlangen(埃尔朗根国际音频实验室);Fraunhofer Institute for Integrated Circuits IIS(弗劳恩霍夫集成电路研究所)
Identification of Hypokinetic Dysarthria Using Acoustic Analysis of Poem Recitation
Brno University of Technology(布尔诺理工大学);Masaryk University(马萨里克大学);St. Anne’s University Hospital(圣安妮大学医院);Central European Institute of Technology(中欧理工学院);Escola Superior Politecnica, Tecnocampus(高等理工学院(科技园区));University of Las Palmas de Gran Canaria(大加那利岛拉斯帕尔马斯大学)