arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2110.05588eess.AScs.LGeess.SP
收藏

DeepFilterNet:一种基于深度滤波的低复杂度全频带音频语音增强框架

DeepFilterNet: A Low Complexity Speech Enhancement Framework for Full-Band Audio based on Deep Filtering

WS Audiology(WS听力集团)

Hendrik Schröter, Alberto N. Escalante-B., Tobias Rosenkranz, Andreas Maier

摘要:

复值处理将基于深度学习的语音增强和信号提取带到了一个新的水平。通常,该过程基于应用于噪声频谱图的时频(TF)掩模,而复数掩模(CM)由于其修改相位的能力而通常优于实值掩模。最近的工作建议使用复数滤波器,而不是与掩码的逐点乘法。这允许利用每个频段内的局部相关性来合并来自先前和未来时间步长的信息。在这项工作中,我们提出了DeepFilterNet,一个两阶段的语音增强框架,利用深度过滤。首先,我们使用ERB缩放增益来增强频谱包络,从而模拟人类的频率感知。第二阶段采用深度滤波来增强语音的周期性分量。除了利用语音的感知特性之外,我们还通过可分离卷积和线性和递归层中的广泛分组来增强网络稀疏性,以设计低复杂度架构。我们进一步表明,我们的两级深度滤波方法在各种频率分辨率和延迟上优于复杂掩码,并与其他最先进的模型相比,证明了令人信服的性能。

英文摘要:

Complex-valued processing has brought deep learning-based speech enhancement and signal extraction to a new level. Typically, the process is based on a time-frequency (TF) mask which is applied to a noisy spectrogram, while complex masks (CM) are usually preferred over real-valued masks due to their ability to modify the phase. Recent work proposed to use a complex filter instead of a point-wise multiplication with a mask. This allows to incorporate information from previous and future time steps exploiting local correlations within each frequency band. In this work, we propose DeepFilterNet, a two stage speech enhancement framework utilizing deep filtering. First, we enhance the spectral envelope using ERB-scaled gains modeling the human frequency perception. The second stage employs deep filtering to enhance the periodic components of speech. Additionally to taking advantage of perceptual properties of speech, we enforce network sparsity via separable convolutions and extensive grouping in linear and recurrent layers to design a low complexity architecture. We further show that our two stage deep filtering approach outperforms complex masks over a variety of frequency resolutions and latencies and demonstrate convincing performance compared to other state-of-the-art models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑