感知动机的音高对齐时频表示的配准与插值
Perceptually Motivated Alignment and Interpolation of Pitch-Aligned Time-Frequency Representations
浏览论文内容
中文总结 AI 辅助
提出一种基于感知协和先验的音高对齐时频表示配准与插值框架,利用排列搜索和最优传输实现音乐结构匹配与过渡,并学习低维调式几何表示。
中文摘要 AI 辅助
我们提出了一个用于音高对齐时频表示的配准与插值框架。基于音调间隔向量,我们引入了一系列扩展,将其重构为可逆算子,最终形成一种新的特征提取器,该提取器将感知协和先验嵌入到音高对齐表示中。据此,我们开发了音乐结构之间的配准与插值方法。对于配准,我们将问题转化为在感知加权距离下的排列搜索,从而无需显式调性检测即可实现稳健匹配,而调性检测在音乐信息检索中本质上具有模糊性。对于插值,我们采用最优传输来生成音高分布之间具有音乐意义的过渡,并提出了一个基于四度/五度循环的圆形公式以尊重和声结构。最后,我们学习了一个低维的调式结构几何表示,旨在分解调式色彩和密度。实验结果表明了所提方法的有效性和音乐性。总之,我们的贡献提供了一种原则性的、纯信号处理的方法来建模音频和符号音乐信号中的音高结构。
英文摘要
We propose a framework for the alignment and interpolation of pitch-aligned time-frequency representations. Building on the tonal interval vector, we introduce a series of extensions that reformulate it as an invertible operator, culminating in a new feature extractor that embeds perceptual consonance priors within a pitch-aligned representation. Accordingly, we develop methods for aligning and interpolating between musical structures. For alignment, we cast the problem as a permutation search under perceptually weighted distances, enabling robust matching without explicit key detection, which is inherently ambiguous in music information retrieval. For interpolation, we employ optimal transport to generate musically meaningful transitions between pitch distributions, proposing a circular formulation over the Circle of Fourths/Fifths to respect harmonic structure. Finally, we learn a low-dimensional geometric representation of scale structure aimed to factorize scale color and density. Experimental results demonstrate the effectiveness and musicality of the proposed methods. Together, our contributions provide a principled, purely signal processing approach to modeling pitch structure in audio and symbolic music signals.
发表机构
- Splice(Splice公司)
机构由 AI 辅助整理,请以论文原文为准。