arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.01133cs.SDcs.LGeess.AS
收藏

深度音乐信息动力学

Deep Music Information Dynamics

University of California San Diego(加州大学圣地亚哥分校)

Shlomo Dubnov

摘要:

音乐是由一系列在时间上组织起来的复杂的同步事件组成的。在本文中,我们介绍了一种新的框架,我们称之为深度音乐信息动力学,它结合了两个并行流-一个低速率的潜在表示流,被认为是捕捉动态的思维过程与较高速率的信息动力学来自音乐数据本身。受人类认知的率失真理论的启发,我们提出了一个框架来探索存在于听者头脑中的想象预期和音乐表面本身的信息动态之间可能的关系。该模型被证明为符号(ESTA)数据的情况下,占声表面将需要更多的层来捕捉仪器的属性和性能表现的变化。数学框架是基于变分编码,首先建立一个高速率表示的音乐观察,然后减少使用比特分配方法成一个并行的低速率数据流。这里考虑的组合损失包括在每个流的时间演化方面的信息速率和在高速率表示和低速率表示之间的互信息方面测量的编码保真度。在本文中提出的模拟,我们能够并列方面的潜在/虚构的的音乐表面的方式,是可量化的和计算处理。本文讨论了一套计算工具,表明压缩和预测之间的权衡是基于时间的音乐生成模型的分析和设计中的一个重要因素。

英文摘要:

Music comprises of a set of complex simultaneous events organized in time. In this paper we introduce a novel framework that we call Deep Musical Information Dynamics, which combines two parallel streams - a low rate latent representation stream that is assumed to capture the dynamics of a thought process contrasted with a higher rate information dynamics derived from the musical data itself. Motivated by rate-distortion theories of human cognition we propose a framework for exploring possible relations between imaginary anticipations existing in the listener's mind and information dynamics of the musical surface itself. This model is demonstrated for the case of symbolic (MIDI) data, as accounting for acoustic surface would require many more layers to capture instrument properties and performance expressive inflections. The mathematical framework is based on variational encoding that first establishes a high rate representation of the musical observations, which is then reduced using a bit-allocation method into a parallel low rate data stream. The combined loss considered here includes both the information rate in terms of time evolution for each stream, and the fidelity of encoding measured in terms of mutual information between the high and low rate representations. In the simulations presented in the paper we are able to juxtapose aspects of latent/imaginary surprisal versus surprisal of the music surface in a manner that is quantifiable and computationally tractable. The set of computational tools is discussed in the paper, suggesting that a trade off between compression and prediction are an important factor in the analysis and design of time-based music generative models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑