arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.05418cs.SDeess.AS
收藏

基于深度ResUNet的音乐声源分离幅度相位解耦估计

Decoupling Magnitude and Phase Estimation with Deep ResUNet for Music Source Separation

ByteDance(字节跳动);University of Surrey(萨里大学)

Qiuqiang Kong, Yin Cao, Haohe Liu, Keunwoo Choi, Yuxuan Wang

摘要:

基于深度神经网络的方法已成功应用于音乐声源分离。它们通常学习从混合光谱图到一组源光谱图的映射,所有这些都只有幅度。这种方法有几个局限性:1)其不正确的相位重建降低了性能,2)它将掩码的幅度限制在0和1之间,而我们观察到在流行的数据集MUSDB 18中,22%的时间频率箱具有超过~1的理想比率掩码值,3)它在非常深的架构上的潜力尚未得到充分开发。我们提出的系统旨在克服这些问题。首先,我们建议通过估计复理想比掩模(cIRMs)来估计相位,其中我们将cIRMs的估计解耦为幅度和相位估计。其次,我们扩展了分离方法,以有效地允许掩模的幅度大于1。最后,我们提出了一个剩余的UNet架构,多达143层。我们提出的系统在MUSDB 18数据集上实现了最先进的MSS结果,特别是在人声上的SDR为8.98 dB,优于之前的最佳性能7.24 dB。源代码可在https://github.com/bytedance/music_source_separation上获得

英文摘要:

Deep neural network based methods have been successfully applied to music source separation. They typically learn a mapping from a mixture spectrogram to a set of source spectrograms, all with magnitudes only. This approach has several limitations: 1) its incorrect phase reconstruction degrades the performance, 2) it limits the magnitude of masks between 0 and 1 while we observe that 22% of time-frequency bins have ideal ratio mask values of over~1 in a popular dataset, MUSDB18, 3) its potential on very deep architectures is under-explored. Our proposed system is designed to overcome these. First, we propose to estimate phases by estimating complex ideal ratio masks (cIRMs) where we decouple the estimation of cIRMs into magnitude and phase estimations. Second, we extend the separation method to effectively allow the magnitude of the mask to be larger than 1. Finally, we propose a residual UNet architecture with up to 143 layers. Our proposed system achieves a state-of-the-art MSS result on the MUSDB18 dataset, especially, a SDR of 8.98~dB on vocals, outperforming the previous best performance of 7.24~dB. The source code is available at: https://github.com/bytedance/music_source_separation

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑