arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.02738cs.SDcs.AI
收藏

噪声降低损失:重新思考音乐大语言模型中的基于似然的评估

When Noise Lowers The Loss: Rethinking Likelihood-Based Evaluation in Music Large Language Models

Georgia Institute of Technology(佐治亚理工学院);ByteDance Inc.(字节跳动公司);Courant Institute of Mathematical Sciences, New York University(纽约大学应用数学科学研究所);Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(Mohamed bin Zayed人工智能大学)

Xiaosha Li, Chun Liu, Ziyu Wang

AI总结:

本文提出通过损失曲线形状而非绝对值来评估音乐生成质量,揭示模型对局部破坏的敏感性,为更有效的训练目标和基准提供新思路。

摘要:

音乐大语言模型(LLMs)的兴起要求稳健的输出质量评估方法,尤其是在区分高质量作品与

英文摘要:

The rise of music large language models (LLMs) demands robust methods of evaluating output quality, especially in distinguishing high-quality compositions from "garbage music". Curiously, we observe that the standard cross-entropy loss -- a core training metric -- often decrease when models encounter systematically corrupted music, undermining its validity as a standalone quality indicator. To investigate this paradox, we introduce noise injection experiment, where controlled noise signal of varying lengths are injected into musical contexts. We hypothesize that a model's loss reacting positively to these perturbations, specifically a sharp increase ("Peak" area) for short injection, can serve as a proxy for its ability to discern musical integrity. Experiments with MusicGen models in the audio waveform domain confirm that Music LLMs respond more strongly to local, texture-level disruptions than to global semantic corruption. Beyond exposing this bias, our results highlight a new principle: the shape of the loss curve -- rather than its absolute value -- encodes critical information about the quality of the generated content (i.e., model behavior). We envision this profile-based evaluation as a label-free, model-intrinsic framework for assessing musical quality -- opening the door to more principled training objectives and sharper benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑