arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.09730cs.SDeess.AS
收藏

扩展演奏技术:乐器识别的下一个里程碑

Extended playing techniques: The next milestone in musical instrument recognition

New York University(纽约大学);Flatiron Institute(弗莱提伦研究所);École Centrale de Nantes(南特中央理工学院);CNRS(法国国家科学研究中心)

Vincent Lostanlen, Joakim Andén, Mathieu Lagrange

摘要:

在产生音符时的表达变化传达了对配器和风格建模至关重要的信息。因此,它在计算机辅助浏览大量数字音乐语料库中起着至关重要的作用。然而,尽管从单个“普通”音符的记录中自动识别乐器被认为是一个解决的问题,但是乐器演奏技术(IPT)的自动识别在很大程度上仍然不发达。我们基准机器听系统查询的例子浏览143个扩展的IPT为16种仪器,共计469三重奏的仪器,静音,和技术。我们确定并讨论了显着优于传统的梅尔频率倒谱系数(MFCC)基线的三个必要条件:增加二阶散射系数来解释幅度调制,纳入长期的时间依赖性,和度量学习使用大利润最近邻(LMNN),以减少类内的变化。在Studio On Line(SOL)数据集上进行评估,我们获得了仪器识别(基线为89.0%)和IPT识别(基线为44.5%)的99.7%和61.0%的精度。我们解释这一收益通过使用非线性降维的实际可用性和可视化的定性评估。

英文摘要:

The expressive variability in producing a musical note conveys information essential to the modeling of orchestration and style. As such, it plays a crucial role in computer-assisted browsing of massive digital music corpora. Yet, although the automatic recognition of a musical instrument from the recording of a single "ordinary" note is considered a solved problem, automatic identification of instrumental playing technique (IPT) remains largely underdeveloped. We benchmark machine listening systems for query-by-example browsing among 143 extended IPTs for 16 instruments, amounting to 469 triplets of instrument, mute, and technique. We identify and discuss three necessary conditions for significantly outperforming the traditional mel-frequency cepstral coefficient (MFCC) baseline: the addition of second-order scattering coefficients to account for amplitude modulation, the incorporation of long-range temporal dependencies, and metric learning using large-margin nearest neighbors (LMNN) to reduce intra-class variability. Evaluating on the Studio On Line (SOL) dataset, we obtain a precision at rank 5 of 99.7% for instrument recognition (baseline at 89.0%) and of 61.0% for IPT recognition (baseline at 44.5%). We interpret this gain through a qualitative assessment of practical usability and visualization using nonlinear dimensionality reduction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑