面向零样本放大器建模:通过音色嵌入控制实现一对多放大器建模
Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control
AI总结:
该研究针对音频放大器建模中一对一仿真的局限,提出基于对比学习的音色嵌入编码器,通过条件控制实现单模型一对多吉他放大器仿真,并验证了其在零样本场景下的有效性,为零样本音频建模提供基础支撑。
摘要:
近年来,通过神经音频效果建模复刻模拟设备电路受到越来越多的关注。现有研究主要聚焦于一对一仿真策略,即对特定设备分别建模。本文针对研究较少的一对多仿真场景展开研究,利用条件控制机制通过单个神经模型仿真多款吉他放大器。在条件表示方面,我们利用包含全面放大器设置的数据集,采用对比学习构建音色嵌入编码器,用于提取各类放大器的风格相关特征。针对零样本应用场景,我们还研究了多种音色嵌入表示策略,针对训练阶段未见过的放大器,将参考音色嵌入与两种基于检索的嵌入方法进行对比评估。研究结果表明,所提方法在实现多功能一对多放大器建模方面具有有效性和潜力,为零样本音频建模应用奠定了基础。
英文摘要:
Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-many emulation, utilizing conditioning mechanisms to emulate multiple guitar amplifiers through a single neural model. For condition representation, we use contrastive learning to build a tone embedding encoder that extracts style-related features of various amplifiers, leveraging a dataset of comprehensive amplifier settings. Targeting zero-shot application scenarios, we also examine various strategies for tone embedding representation, evaluating referenced tone embedding against two retrieval-based embedding methods for amplifiers unseen in the training time. Our findings showcase the efficacy and potential of the proposed methods in achieving versatile one-to-many amplifier modeling, contributing a foundational step towards zero-shot audio modeling applications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。