arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.14375cs.CL
收藏

以音乐音频剪辑为条件的歌词行的生成

Generation of lyrics lines conditioned on music audio clips

University of Waterloo(滑铁卢大学)

Olga Vechtomova, Gaurav Sahu, Dhruv Kumar

摘要:

我们提出了一个系统,用于生成新的歌词线的音乐音频的条件。双峰神经网络模型学习生成以任何给定的短音频片段为条件的线。该模型由频谱变分自编码器和文本VAE组成。自动和人工评估都证明了我们的模型在生成与给定音频片段匹配的情感影响线方面的有效性。该系统旨在作为歌曲作者的创作工具。

英文摘要:

We present a system for generating novel lyrics lines conditioned on music audio. A bimodal neural network model learns to generate lines conditioned on any given short audio clip. The model consists of a spectrogram variational autoencoder (VAE) and a text VAE. Both automatic and human evaluations demonstrate effectiveness of our model in generating lines that have an emotional impact matching a given audio clip. The system is intended to serve as a creativity tool for songwriters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑