MMMOS:多领域多轴音频质量评估
MMMOS: Multi-domain Multi-axis Audio Quality Assessment
AI总结:
MMMOS通过融合三种预训练编码器的帧级嵌入,实现了多领域多轴的音频质量评估,有效提升了音频质量评估的准确性和泛化能力。
摘要:
准确的音频质量估计对于开发和评估音频生成、检索和增强系统至关重要。现有非侵入式评估模型预测语音的单一平均意见分数(MOS),融合了多样的感知因素,无法超越语音进行泛化。我们提出MMMOS,一种无参考、多领域的音频质量评估系统,估计四个正交轴:生产质量、生产复杂性、内容享受和内容有用性,涵盖语音、音乐和环境声音。MMMOS融合了三个预训练编码器(WavLM、MuQ和M2D)的帧级嵌入,并评估三种聚合策略与四种损失函数。通过融合前八名模型,MMMOS在均方误差上减少了20-30%,在Kendall's τ上增加了4-5%,在八项生产复杂性指标中获得第一名,在32项挑战指标中排名前三的有17项。
英文摘要:
Accurate audio quality estimation is essential for developing and evaluating audio generation, retrieval, and enhancement systems. Existing non-intrusive assessment models predict a single Mean Opinion Score (MOS) for speech, merging diverse perceptual factors and failing to generalize beyond speech. We propose MMMOS, a no-reference, multi-domain audio quality assessment system that estimates four orthogonal axes: Production Quality, Production Complexity, Content Enjoyment, and Content Usefulness across speech, music, and environmental sounds. MMMOS fuses frame-level embeddings from three pretrained encoders (WavLM, MuQ, and M2D) and evaluates three aggregation strategies with four loss functions. By ensembling the top eight models, MMMOS shows a 20-30% reduction in mean squared error and a 4-5% increase in Kendall's τ versus baseline, gains first place in six of eight Production Complexity metrics, and ranks among the top three on 17 of 32 challenge metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。