听你想要的:基于神经网络的通用声音模型
Listen to What You Want: Neural Network-based Universal Sound Selector
摘要:
能够控制我们想要收听的声学事件(AE)将允许开发更可控的可听设备。本文讨论了AE声音选择(或删除)的问题,我们定义为提取(或抑制)的所有声音属于一个或多个所需的AE类。虽然这个问题可以通过源分离和AE分类的组合来解决,但这是解决这个问题的次优方法。此外,源分离通常需要知道源的最大数量,这在处理不良事件时可能不切实际。在本文中,我们提出了一个通用的声音选择神经网络,使直接选择AE声音从混合给定的用户指定的目标AE类。所提出的框架可以显式优化,同时选择声音从多个所需的AE类,独立的混合物中的源的数量。我们的实验表明,所提出的方法实现了有前途的AE声音选择性能,并可以推广到混合物与一些在训练过程中看不见的来源。
英文摘要:
Being able to control the acoustic events (AEs) to which we want to listen would allow the development of more controllable hearable devices. This paper addresses the AE sound selection (or removal) problems, that we define as the extraction (or suppression) of all the sounds that belong to one or multiple desired AE classes. Although this problem could be addressed with a combination of source separation followed by AE classification, this is a sub-optimal way of solving the problem. Moreover, source separation usually requires knowing the maximum number of sources, which may not be practical when dealing with AEs. In this paper, we propose instead a universal sound selection neural network that enables to directly select AE sounds from a mixture given user-specified target AE classes. The proposed framework can be explicitly optimized to simultaneously select sounds from multiple desired AE classes, independently of the number of sources in the mixture. We experimentally show that the proposed method achieves promising AE sound selection performance and could be generalized to mixtures with a number of sources that are unseen during training.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。