arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1504.07372cs.SD
收藏

基于二进制掩码的音频声源分离时频折衷算法

Time-Frequency Trade-offs for Audio Source Separation with Binary Masks

University of Surrey(萨里大学)

Andrew J. R. Simpson

摘要:

短时傅立叶变换(STFT)为基于二进制掩码的音频声源分离方法提供了基础。在计算频谱图时,STFT窗口大小参数化时间和频率分辨率之间的权衡。然而,目前还不知道这个参数如何影响二进制掩码的操作在分离质量方面的真实世界的信号,如语音或音乐。在这里,我们证明了在STFT的时间和频率之间的权衡,用于执行理想的二进制掩码分离,取决于要分离的源的类型。特别是,我们证明了不同的窗口大小是最佳的语音和音乐信号的不同组合分离。我们的研究结果对机器听觉和一般的机器学习具有广泛的意义。

英文摘要:

The short-time Fourier transform (STFT) provides the foundation of binary-mask based audio source separation approaches. In computing a spectrogram, the STFT window size parameterizes the trade-off between time and frequency resolution. However, it is not yet known how this parameter affects the operation of the binary mask in terms of separation quality for real-world signals such as speech or music. Here, we demonstrate that the trade-off between time and frequency in the STFT, used to perform ideal binary mask separation, depends upon the types of source that are to be separated. In particular, we demonstrate that different window sizes are optimal for separating different combinations of speech and musical signals. Our findings have broad implications for machine audition and machine learning in general.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑