arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.10646cs.SDeess.AS
收藏

面向零样本放大器建模:通过音色嵌入控制实现一对多放大器建模

Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding control

National Taiwan University(国立台湾大学);Positive Grid(Positive Grid 公司)

Yu-Hua Chen, Yen-Tung Yeh, Yuan-Chiao Cheng, Jui-Te Wu, Yu-Hsiang Ho, Jyh-Shing Roger Jang, Yi-Hsuan Yang

AI总结:

该研究针对音频放大器建模中一对一仿真的局限,提出基于对比学习的音色嵌入编码器,通过条件控制实现单模型一对多吉他放大器仿真,并验证了其在零样本场景下的有效性,为零样本音频建模提供基础支撑。

摘要:

近年来,通过神经音频效果建模复刻模拟设备电路受到越来越多的关注。现有研究主要聚焦于一对一仿真策略,即对特定设备分别建模。本文针对研究较少的一对多仿真场景展开研究,利用条件控制机制通过单个神经模型仿真多款吉他放大器。在条件表示方面,我们利用包含全面放大器设置的数据集,采用对比学习构建音色嵌入编码器,用于提取各类放大器的风格相关特征。针对零样本应用场景,我们还研究了多种音色嵌入表示策略,针对训练阶段未见过的放大器,将参考音色嵌入与两种基于检索的嵌入方法进行对比评估。研究结果表明,所提方法在实现多功能一对多放大器建模方面具有有效性和潜力,为零样本音频建模应用奠定了基础。

英文摘要:

Replicating analog device circuits through neural audio effect modeling has garnered increasing interest in recent years. Existing work has predominantly focused on a one-to-one emulation strategy, modeling specific devices individually. In this paper, we tackle the less-explored scenario of one-to-many emulation, utilizing conditioning mechanisms to emulate multiple guitar amplifiers through a single neural model. For condition representation, we use contrastive learning to build a tone embedding encoder that extracts style-related features of various amplifiers, leveraging a dataset of comprehensive amplifier settings. Targeting zero-shot application scenarios, we also examine various strategies for tone embedding representation, evaluating referenced tone embedding against two retrieval-based embedding methods for amplifiers unseen in the training time. Our findings showcase the efficacy and potential of the proposed methods in achieving versatile one-to-many amplifier modeling, contributing a foundational step towards zero-shot audio modeling applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑