arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2606.15888cs.SDcs.AIeess.AS

NVMOS:语音中非语言发声质量评估

NVMOS: Non-Verbal Vocalization Quality Assessment in Speech

University of Science and Technology of China(中国科学技术大学)

Jialong Mai, Jinxin Ji, Xiaofen Xing, Wencui Liu, Xiangmin Xu

AI总结:

针对非语言发声(如笑声、叹息)的感知质量评估空白,构建NV-MOS数据集,提出首个专用模型NVMOS,通过局部聚焦模块达到专家级评估一致性。

摘要:

非语言发声(NVs),如笑声、叹息和咳嗽,是情感和意图的重要声学线索。现有的语音质量评估方法通常关注整体自然度,而非语言TTS评估主要检查目标NV是否以正确的类型和位置出现。然而,NV事件本身的感知质量仍未被充分探索。为填补这一空白,我们构建了一个NV-MOS数据集,包含来自多个NV-TTS系统的输出和自然发生的NV样本,并由三位声学专家根据感知质量量表进行评分。我们进一步分析了支持音频的多模态大语言模型(如Gemini),发现其评分与专家评分之间存在明显不一致。这些结果表明,通用多模态模型无法可靠地替代人类进行NV质量评估。随后,我们提出了NVMOS,据我们所知,这是第一个能够可靠预测语音中NV事件感知质量的模型。实验结果表明,通过局部NV事件聚焦模块,NVMOS达到了与人类MOS评分专家级或更强的一致性。

英文摘要:

Non-verbal vocalizations (NVs), such as laughter, sighs, and coughs, are important acoustic cues for emotion and intent. Existing speech quality assessment methods typically focus on overall naturalness, while non-verbal TTS evaluations mainly examine whether a target NV appears with the correct type and position. However, the perceptual quality of NV events themselves remains underexplored. To address this gap, we construct an NV-MOS dataset containing outputs from multiple NV-TTS systems and naturally occurring NV samples, with ratings collected from three acoustic experts on a perceptual quality scale. We further analyze audio-capable multimodal large language models such as Gemini and find clear inconsistencies between their scores and expert ratings. These results suggest that general-purpose multimodal models cannot reliably replace human judgments for NV quality assessment. We then propose NVMOS, to our knowledge the first model that can reliably predict the perceptual quality of NV events in speech. Experimental results show that, with a local NV-event focusing module, NVMOS reaches expert-level or stronger agreement with human MOS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑