arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2507.04094eess.AScs.AIcs.CL
收藏

MMMOS:多领域多轴音频质量评估

MMMOS: Multi-domain Multi-axis Audio Quality Assessment

National Taiwan University(国立台湾大学)

Yi-Cheng Lin, Jia-Hung Chen, Hung-yi Lee

AI总结:

MMMOS通过融合三种预训练编码器的帧级嵌入,实现了多领域多轴的音频质量评估,有效提升了音频质量评估的准确性和泛化能力。

摘要:

准确的音频质量估计对于开发和评估音频生成、检索和增强系统至关重要。现有非侵入式评估模型预测语音的单一平均意见分数(MOS),融合了多样的感知因素,无法超越语音进行泛化。我们提出MMMOS,一种无参考、多领域的音频质量评估系统,估计四个正交轴:生产质量、生产复杂性、内容享受和内容有用性,涵盖语音、音乐和环境声音。MMMOS融合了三个预训练编码器(WavLM、MuQ和M2D)的帧级嵌入,并评估三种聚合策略与四种损失函数。通过融合前八名模型,MMMOS在均方误差上减少了20-30%,在Kendall's τ上增加了4-5%,在八项生产复杂性指标中获得第一名,在32项挑战指标中排名前三的有17项。

英文摘要:

Accurate audio quality estimation is essential for developing and evaluating audio generation, retrieval, and enhancement systems. Existing non-intrusive assessment models predict a single Mean Opinion Score (MOS) for speech, merging diverse perceptual factors and failing to generalize beyond speech. We propose MMMOS, a no-reference, multi-domain audio quality assessment system that estimates four orthogonal axes: Production Quality, Production Complexity, Content Enjoyment, and Content Usefulness across speech, music, and environmental sounds. MMMOS fuses frame-level embeddings from three pretrained encoders (WavLM, MuQ, and M2D) and evaluates three aggregation strategies with four loss functions. By ensembling the top eight models, MMMOS shows a 20-30% reduction in mean squared error and a 4-5% increase in Kendall's τ versus baseline, gains first place in six of eight Production Complexity metrics, and ranks among the top three on 17 of 32 challenge metrics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑