DeepRapper:具有韵律和节奏建模的神经说唱生成
DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling
摘要:
说唱世代的目标是制作歌词和相应的歌唱节拍,需要模仿押韵和节奏。以前的说唱一代作品注重押韵的歌词,但忽视了节奏节拍,而节奏节拍对于说唱表演很重要。在本文中,我们开发了DeepRapper,这是一个基于Transformer的说唱生成系统,可以对押韵和节奏进行建模。由于没有可用的说唱数据集与节奏节拍,我们开发了一个数据采掘管道来收集一个大规模的说唱数据集,其中包括大量的说唱歌曲对齐的歌词和节奏节拍。其次,我们设计了一个基于transformer的自回归语言模型,它仔细地对韵律和节奏进行建模。具体来说,我们生成的歌词在相反的顺序与韵律表示和约束的韵律增强和插入一个节拍符号到歌词的节奏/节拍建模。据我们所知,DeepRapper是第一个同时生成押韵和节奏的说唱系统。客观和主观的评价都表明,DeepRapper生成具有韵律和节奏的创造性和高质量的说唱。代码将在GitHub上发布。
英文摘要:
Rap generation, which aims to produce lyrics and corresponding singing beats, needs to model both rhymes and rhythms. Previous works for rap generation focused on rhyming lyrics but ignored rhythmic beats, which are important for rap performance. In this paper, we develop DeepRapper, a Transformer-based rap generation system that can model both rhymes and rhythms. Since there is no available rap dataset with rhythmic beats, we develop a data mining pipeline to collect a large-scale rap dataset, which includes a large number of rap songs with aligned lyrics and rhythmic beats. Second, we design a Transformer-based autoregressive language model which carefully models rhymes and rhythms. Specifically, we generate lyrics in the reverse order with rhyme representation and constraint for rhyme enhancement and insert a beat symbol into lyrics for rhythm/beat modeling. To our knowledge, DeepRapper is the first system to generate rap with both rhymes and rhythms. Both objective and subjective evaluations demonstrate that DeepRapper generates creative and high-quality raps with rhymes and rhythms. Code will be released on GitHub.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。