arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.00895cs.SDcs.LGeess.AS
收藏

Pop2Piano:基于流行音频的钢琴翻奏生成

Pop2Piano : Pop Audio-based Piano Cover Generation

Rebellions Inc.(Rebellions公司);Seoul National University(首尔国立大学)

Jongho Choi, Kyogu Lee

AI总结:

提出Pop2Piano,首个直接从流行音频生成钢琴翻奏的Transformer网络,无需旋律和和弦提取模块,通过自动化流程构建同步数据对进行训练,能生成合理的钢琴翻奏。

摘要:

许多人喜欢流行音乐的钢琴翻奏。然而,自动生成流行音乐钢琴翻奏的任务仍研究不足。这部分是由于缺乏同步的{流行音乐,钢琴翻奏}数据对,这使得应用最新的数据密集型深度学习方法变得具有挑战性。为了利用数据驱动方法的优势,我们使用自动化流程制作了大量配对且同步的{流行音乐,钢琴翻奏}数据。在本文中,我们提出了Pop2Piano,这是一个Transformer网络,能在给定流行音乐波形的情况下生成钢琴翻奏。据我们所知,这是首个直接从流行音频生成钢琴翻奏而不使用旋律和和弦提取模块的模型。我们证明了使用我们的数据集训练的Pop2Piano能够生成合理的钢琴翻奏。

英文摘要:

Piano covers of pop music are enjoyed by many people. However, the task of automatically generating piano covers of pop music is still understudied. This is partly due to the lack of synchronized {Pop, Piano Cover} data pairs, which made it challenging to apply the latest data-intensive deep learning-based methods. To leverage the power of the data-driven approach, we make a large amount of paired and synchronized {Pop, Piano Cover} data using an automated pipeline. In this paper, we present Pop2Piano, a Transformer network that generates piano covers given waveforms of pop music. To the best of our knowledge, this is the first model to generate a piano cover directly from pop audio without using melody and chord extraction modules. We show that Pop2Piano, trained with our dataset, is capable of producing plausible piano covers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑