arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.03395cs.SDcs.AIcs.LGcs.MM
收藏

APEX:面向AI生成音乐的大规模多任务美学感知流行度预测

APEX: Large-scale Multi-task Aesthetic-Informed Popularity Prediction for AI-Generated Music

AMAAI Lab, Singapore University of Technology and Design(新加坡科技设计大学AMAAI实验室)

Jaavid Aktar Husain, Dorien Herremans

AI总结:

提出APEX框架,利用MERT音频嵌入联合预测AI生成音乐的流行度指标与五维美学质量,在Music Arena数据集上验证了美学特征对偏好预测的泛化能力。

摘要:

音乐流行度预测因其对艺术家、平台和推荐系统的重要性而吸引了越来越多的研究兴趣。然而,AI生成音乐平台的爆炸式增长创造了一个全新且很大程度上未被探索的领域,每天都有大量歌曲被生产和消费,而没有传统的艺术家声誉或唱片公司支持。在这一探索中,美学质量是关键但尚未被研究的因素。我们提出了APEX,这是首个面向AI生成音乐的大规模多任务学习框架,在来自Suno和Udio的超过21.1万首歌曲(1万小时音频)上训练,该框架联合预测基于参与度的流行度信号——流媒体播放量和点赞分数——以及从MERT(一个自监督音乐理解模型)提取的冻结音频嵌入中的五个感知美学质量维度。美学质量和流行度捕捉了音乐的互补方面,两者结合被证明是有价值的:在Music Arena数据集上的分布外评估中,该数据集包含训练期间未见过的十一个生成音乐系统之间的成对人类偏好对决,引入美学特征持续改进了偏好预测,展示了所学表示在生成架构上的强大泛化能力。

英文摘要:

Music popularity prediction has attracted growing research interest, with relevance to artists, platforms, and recommendation systems. However, the explosive rise of AI-generated music platforms has created an entirely new and largely unexplored landscape, where a surge of songs is produced and consumed daily without the traditional markers of artist reputation or label backing. Key, yet unexplored in this pursuit is aesthetic quality. We propose APEX, the first large-scale multi-task learning framework for AI-generated music, trained on over 211k songs (10k hours of audio) from Suno and Udio, that jointly predicts engagement-based popularity signals - streams and likes scores - alongside five perceptual aesthetic quality dimensions from frozen audio embeddings extracted from MERT, a self-supervised music understanding model. Aesthetic quality and popularity capture complementary aspects of music that together prove valuable: in an out-of-distribution evaluation on the Music Arena dataset, comprising pairwise human preference battles across eleven generative music systems unseen during training, including aesthetic features consistently improves preference prediction, demonstrating strong generalisation of the learned representations across generative architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑