arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.05528cs.AIcs.MM
收藏

MusIAC:一个可扩展的多级控制音乐填充应用生成框架

MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

University of Sussex(萨塞克斯大学);Singapore University of Technology and Design(新加坡科技设计大学)

Rui Guo, Ivor Simpson, Chris Kiefer, Thor Magnusson, Dorien Herremans

摘要:

我们提出了一个新的音乐生成框架的音乐填充,与用户友好的界面。填充是指在给定周围多轨音乐的情况下生成音乐片段的任务。所提出的变压器为基础的框架是可扩展的新的控制令牌作为添加的音乐控制令牌,如每酒吧的音调张力和轨道复调水平在这项工作中。我们探讨了包括几个音乐上有意义的控制令牌的影响,并使用客观的指标,音高和节奏的结果进行评估。我们的研究结果表明,添加额外的控制标记有助于生成与原始音乐具有更强风格相似性的音乐。它还为用户提供了更多的控制,以改变属性,如音乐纹理和音调张力在每个酒吧相比,以前的研究,只提供控制轨道密度。我们在Google Colab笔记本中呈现模型,以实现交互式生成。

英文摘要:

We present a novel music generation framework for music infilling, with a user friendly interface. Infilling refers to the task of generating musical sections given the surrounding multi-track music. The proposed transformer-based framework is extensible for new control tokens as the added music control tokens such as tonal tension per bar and track polyphony level in this work. We explore the effects of including several musically meaningful control tokens, and evaluate the results using objective metrics related to pitch and rhythm. Our results demonstrate that adding additional control tokens helps to generate music with stronger stylistic similarities to the original music. It also provides the user with more control to change properties like the music texture and tonal tension in each bar compared to previous research which only provided control for track density. We present the model in a Google Colab notebook to enable interactive generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑