Tokyo Institute of Technology(东京工业大学);Qosmo Inc.(Qosmo公司)
Christopher Mitcheltree, Hideki Koike
备注:
The latest version of the system is to appear at EvoMUSART 2021 as a full paper. Audio samples of the latest system can be listened to at https://bit.ly/serum_rnn
发表信息:
4th Workshop on Machine Learning for Creativity and Design at NeurIPS 2020, Vancouver, Canada
学习编程音频制作VST插件是一个耗时的过程,通常通过低效的试验和错误获得,只有在广泛的用户体验后才能掌握。我们提出了一个白盒,迭代系统,提供一步一步的指令,应用音频效果,以改变用户的音频信号朝着所需的声音。我们将我们的系统应用于Xfer Records Serum:目前音频制作社区使用的最流行和最复杂的VST合成器之一。我们的结果表明,我们的系统始终能够为各种不同的音频效果和合成器预设提供有用的反馈。
英文摘要:
Learning to program an audio production VST plugin is a time consuming process, usually obtained through inefficient trial and error and only mastered after extensive user experience. We propose a white-box, iterative system that provides step-by-step instructions for applying audio effects to change a user's audio signal towards a desired sound. We apply our system to Xfer Records Serum: currently one of the most popular and complex VST synthesizers used by the audio production community. Our results indicate that our system is consistently able to provide useful feedback for a variety of different audio effects and synthesizer presets.
SerumRNN: Step by Step Audio VST Effect Programming
Tokyo Institute of Technology(东京工业大学);Qosmo Inc(Qosmo公司)
学习对音频制作VST合成器进行编程是一个耗时的过程,通常是通过低效的尝试和错误获得的,只有在多年的经验之后才能掌握。作为声音设计师的教育和创造性工具,我们提出了SerumRNN:一个系统,它提供了一步一步的指令,用于应用音频效果来将用户的输入音频改变为所需的声音。我们将我们的系统应用于Xfer Records Serum:目前音频制作社区使用的最流行和最复杂的VST合成器之一。我们的研究结果表明,SerumRNN始终能够为各种不同的音频效果和合成器提供有用的反馈。我们展示了使用迭代系统的好处,并表明SerumRNN学会了对效果进行优先级排序,并且可以发现比各种基线更有效的效果顺序序列。
Enkidu: Universal Frequential Perturbation for Real-Time Audio Privacy Protection against Voice Deepfakes
College of Computer Science;Technology, Zhejiang University Hangzhou China;School of Big Data \& Software Engineering, Chongqing University Chongqing China;Technology, Zhejiang University;School of Big Data \& Software Engineering, Chongqing University