arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1707.09887cs.IRcs.SD
收藏

学习音频-乐谱对应,用于乐谱识别和离线对齐

Learning Audio - Sheet Music Correspondences for Score Identification and Offline Alignment

Johannes Kepler University Linz(林茨约翰内斯·开普勒大学);The Austrian Research Institute for Artificial Intelligence (OFAI)(奥地利人工智能研究所)

Matthias Dorfer, Andreas Arzt, Gerhard Widmer

摘要:

这项工作解决的问题,匹配短摘录的音频与他们各自的对应物在乐谱图像。我们展示了如何采用基于神经网络的跨模态嵌入空间来解决以下两个与乐谱相关的任务:当给定音乐音频作为搜索查询时,从数据库中检索正确的乐谱;以及将乐谱的音频记录与相应的乐谱图像对齐。我们证明了这一点的可行性,在实验中的古典钢琴音乐由五个不同的作曲家(巴赫,海顿,莫扎特,贝多芬和肖邦),并提供了一个讨论,为什么我们希望多模态神经网络是一个富有成效的范例,同时处理乐谱和音频。

英文摘要:

This work addresses the problem of matching short excerpts of audio with their respective counterparts in sheet music images. We show how to employ neural network-based cross-modality embedding spaces for solving the following two sheet music-related tasks: retrieving the correct piece of sheet music from a database when given a music audio as a search query; and aligning an audio recording of a piece with the corresponding images of sheet music. We demonstrate the feasibility of this in experiments on classical piano music by five different composers (Bach, Haydn, Mozart, Beethoven and Chopin), and additionally provide a discussion on why we expect multi-modal neural networks to be a fruitful paradigm for dealing with sheet music and audio at the same time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑