arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.05024cs.SDcs.CLcs.IR
收藏

MIDI-to-Tab:基于掩码语言建模的吉他六线谱推断

MIDI-to-Tab: Guitar Tablature Inference via Masked Language Modeling

Queen Mary University of London(伦敦玛丽女王大学)

Drew Edwards, Xavier Riley, Pedro Sarmento, Simon Dixon

AI总结:

本文提出 MIDI-to-Tab,用掩码语言建模训练编码器-解码器 Transformer 推断音符的弦品分配,并经 DadaGP 预训练与专业数据微调;用户研究显示其可演奏性显著优于现有算法。

摘要:

吉他六线谱通过在特定调弦下将每个音符分配给吉他的某根弦和某个品,丰富了传统乐谱的结构,精确指出应在乐器上的何处演奏该音符。从符号音乐表示生成六线谱的问题,涉及在整首作品或整场演奏中为每个音符推断这种弦与品的分配。在吉他上,大多数音高都可能有多种弦-品分配方式,这会产生庞大的组合空间,使穷举搜索方法无法实施。多数现代方法采用基于约束的动态规划,以最小化某种代价函数(例如手部位置移动)。在本研究中,我们提出了一种用于符号吉他六线谱估计的新型深度学习解决方案。我们以掩码语言建模范式训练一个编码器-解码器 Transformer 模型,用于将音符分配到弦上。该模型首先在包含超过25K份六线谱的数据集 DadaGP 上进行预训练,随后在一组精心整理的专业转录吉他演奏上进行微调。鉴于评估六线谱质量具有主观性,我们在吉他手中开展了一项用户研究,要求参与者对同一个四小节片段的多个六线谱版本的可演奏性进行评分。结果表明,我们的系统显著优于竞争算法。

英文摘要:

Guitar tablatures enrich the structure of traditional music notation by assigning each note to a string and fret of a guitar in a particular tuning, indicating precisely where to play the note on the instrument. The problem of generating tablature from a symbolic music representation involves inferring this string and fret assignment per note across an entire composition or performance. On the guitar, multiple string-fret assignments are possible for most pitches, which leads to a large combinatorial space that prevents exhaustive search approaches. Most modern methods use constraint-based dynamic programming to minimize some cost function (e.g.\ hand position movement). In this work, we introduce a novel deep learning solution to symbolic guitar tablature estimation. We train an encoder-decoder Transformer model in a masked language modeling paradigm to assign notes to strings. The model is first pre-trained on DadaGP, a dataset of over 25K tablatures, and then fine-tuned on a curated set of professionally transcribed guitar performances. Given the subjective nature of assessing tablature quality, we conduct a user study amongst guitarists, wherein we ask participants to rate the playability of multiple versions of tablature for the same four-bar excerpt. The results indicate our system significantly outperforms competing algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑