arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.12656cs.SDeess.AS
收藏

MoodLoopGP:利用多粒度特征生成情感条件化的循环六线谱音乐

MoodLoopGP: Generating Emotion-Conditioned Loop Tablature Music with Multi-Granular Features

Queen Mary University of London(伦敦玛丽女王大学)

Wenqian Cui, Pedro Sarmento, Mathieu Barthet

AI总结:

本文在 LooperGP 基础上提出 MoodLoopGP,通过融合歌曲级与小节级多粒度音乐特征控制情感表达,并经算法、人工评估及消融研究验证其生成快乐与悲伤循环六线谱音乐的有效性。

摘要:

可循环音乐生成系统支持多种应用,但往往缺乏可控性与定制能力。我们认为增强可控性能够丰富这些模型,而情感表达对创作者和听众而言都是关键方面。因此,本文基于可循环六线谱生成模型 LooperGP,探索赋予系统对所传达情感的控制能力。为实现这种条件生成,我们提出在模型训练和推理过程中利用多粒度语义与音乐特征来整合音乐知识。具体而言,我们结合歌曲级特征(Emotion Labels、Tempo 和 Mode)与小节级特征(Tonal Tension),共同引导情感表达。通过算法评估和人工评估,我们证明该方法能够有效生成传达快乐与悲伤这两种对比鲜明的目标情感的音乐。本文还开展了消融研究,以阐明该方法结果背后的促成因素。

英文摘要:

Loopable music generation systems enable diverse applications, but they often lack controllability and customization capabilities. We argue that enhancing controllability can enrich these models, with emotional expression being a crucial aspect for both creators and listeners. Hence, building upon LooperGP, a loopable tablature generation model, this paper explores endowing systems with control over conveyed emotions. To enable such conditional generation, we propose integrating musical knowledge by utilizing multi-granular semantic and musical features during model training and inference. Specifically, we incorporate song-level features (Emotion Labels, Tempo, and Mode) and bar-level features (Tonal Tension) together to guide emotional expression. Through algorithmic and human evaluations, we demonstrate the approach's effectiveness in producing music conveying two contrasting target emotions, happiness and sadness. An ablation study is also conducted to clarify the contributing factors behind our approach's results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑