基于可微分数字信号处理的实时音色重映射
Real-time Timbre Remapping with Differentiable DSP
AI总结：
本文提出基于可微分DSP和特征差异损失的实时音色重映射方法，将原声小军鼓的音色表现映射到TR-808合成器控制参数上，实现保留分级音色调制的实时转换。
摘要：
音色是多种音乐语境中的主要表现手段。然而，主流的音频驱动合成方法主要依赖音高和响度包络，实际上抹平了输入中的音色表现。我们的方法借鉴音色类比的概念，研究如何将输入信号中的音色表现映射到合成器的控制参数上。利用可微分数字信号处理，我们的方法通过一种新颖的特征差异损失直接优化合成器参数。该损失函数旨在学习音乐事件之间的相对音色差异，优先关注乐句内分级音色调制的细微变化，从而在音色空间中实现有意义的转换。我们以小军鼓演奏为案例研究，其中音色表现处于核心地位，展示了从原声小军鼓到以Roland TR-808为模型的可微分合成器的实时音色重映射。
英文摘要：
Timbre is a primary mode of expression in diverse musical contexts. However, prevalent audio-driven synthesis methods predominantly rely on pitch and loudness envelopes, effectively flattening timbral expression from the input. Our approach draws on the concept of timbre analogies and investigates how timbral expression from an input signal can be mapped onto controls for a synthesizer. Leveraging differentiable digital signal processing, our method facilitates direct optimization of synthesizer parameters through a novel feature difference loss. This loss function, designed to learn relative timbral differences between musical events, prioritizes the subtleties of graded timbre modulations within phrases, allowing for meaningful translations in a timbre space. Using snare drum performances as a case study, where timbral expression is central, we demonstrate real-time timbre remapping from acoustic snare drums to a differentiable synthesizer modeled after the Roland TR-808.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
