声音生成中的质量-多样性搜索:用于音频探索的创新引擎研究
Quality-Diversity Search in Sound Generation: Investigating Innovation Engines for Audio Exploration
AI总结:
本研究将质量多样性算法与监督判别模型结合,通过多频段CPPN和DSP图生成多样化合成声音,并分析进化路径与时间生态位,展示了创新引擎在声音发现中的潜力。
摘要:
本研究解决了作曲家和声音设计师在创建和优化工具以实现其音乐目标时所面临的挑战。通过利用进化过程促进多样性并培养偶然发现,我们自动化了在未知声音空间中的搜索以发现声音,认为促进多样性的算法可以弥合声音的理论实现与实际可访问性之间的差距。我们描述了一个生成式声音合成系统,该系统将质量多样性(QD)算法与监督判别模型相结合,灵感来自创新引擎算法,并探索了不同配置以及所选合成方法与判别模型之间的相互作用。我们研究了组合模式生成网络(CPPN)和数字信号处理(DSP)图之间的交互,引入了一种新颖的方法,该方法使用多个专门针对不同频率范围的CPPN;这产生了更简单的网络,同时保持了与单CPPN设置相当的性能。我们还通过分析音乐和非音乐背景之间的目标切换来研究进化垫脚石,揭示了谱系如何穿越看似不可能的路径到达当前精英。将先前研究的行为空间扩展到包括各种声音持续时间,我们发现了时间生态位内的特化。结果表明,CPPN和DSP图与多维表型精英档案(MAP-Elites)和深度学习分类器相结合,可以生成大量多样的合成声音,在时间和上下文维度上具有多样性和创新性。我们通过在线探索器和渲染的声音文件呈现生成的声音对象,并在音乐创作的背景下,展示了一个实验性应用,该应用展示了它们在不同持续时间和上下文中的创造潜力。
英文摘要:
This study addresses the challenges composers and sound designers face in creating and refining tools to achieve their musical goals. Using evolutionary processes to promote diversity and foster serendipitous discoveries, we automate the search through uncharted sonic spaces for sound discovery, arguing that diversity-promoting algorithms can bridge the gap between the theoretical realisation and practical accessibility of sounds. We describe a system for generative sound synthesis combining Quality Diversity (QD) algorithms with a supervised discriminative model, inspired by the Innovation Engine algorithm, and explore different configurations and the interplay between the chosen synthesis approach and the discriminative model. We examine the interaction between Compositional Pattern Producing Networks (CPPNs) and Digital Signal Processing (DSP) graphs, introducing a novel approach that uses multiple specialised CPPNs for different frequency ranges; this yields simpler networks while maintaining performance comparable to single-CPPN setups. We also investigate evolutionary stepping stones by analysing goal switches between musical and non-musical contexts, revealing how lineages traverse unlikely paths to current elites. Expanding the behaviour space of a previous study to include various sound durations, we uncover specialisation within temporal niches. Results indicate that CPPN and DSP graphs coupled with a Multi-dimensional Archive of Phenotypic Elites (MAP-Elites) and a deep learning classifier can generate a substantial variety of synthetic sounds, diverse and innovative across temporal and contextual dimensions. We present the generated sound objects through an online explorer and as rendered sound files, and, in the context of music composition, an experimental application that showcases their creative potential across various durations and contexts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。