arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.09019eess.ASeess.SP
收藏

Fast FullSubNet:单通道语音增强的加速全带与子带融合模型

Fast FullSubNet: Accelerate Full-band and Sub-band Fusion Model for Single-channel Speech Enhancement

Xiang Hao, Xiaofei Li

摘要:

FullSubNet是我们最近提出的实时单通道语音增强网络,在深度噪声抑制(DNS)挑战数据集上实现了出色的性能。FullSubNet已经提出了许多变体,但它们都专注于更好的性能的结构设计,很少关注计算效率。对于许多语音增强应用,一个关键特征是系统运行在实时、延迟敏感、电池供电的平台上,这严格限制了算法延迟和计算复杂度。在这项工作中,我们提出了一个新的架构命名为快速FullSubNet致力于加速FullSubNet的计算。具体而言,Fast FullSubNet通过使用级联的线性到梅尔全带、子带和梅尔到线性全带模型来处理梅尔频域中的子带语音频谱,使得子带计算中涉及的频率大大降低。在此基础上,提出了一种对子带输入序列进行下采样的方法,进一步降低了时间轴上的计算复杂度。实验结果表明,与FullSubNet相比,FastFullSubNet的计算复杂度仅为13%,处理时间仅为16%,性能相当甚至更好.代码和音频示例可在https://github.com/Audio-WestlakeU/FullSubNet上获得。

英文摘要:

FullSubNet is our recently proposed real-time single-channel speech enhancement network that achieves outstanding performance on the Deep Noise Suppression (DNS) Challenge dataset. A number of variants of FullSubNet have been proposed, but they all focus on the structure design towards better performance and are rarely concerned with computational efficiency. For many speech enhancement applications, a key feature is that system runs on a real-time, latency-sensitive, battery-powered platform, which strictly limits the algorithm latency and computational complexity. In this work, we propose a new architecture named Fast FullSubNet dedicated to accelerating the computation of FullSubNet. Specifically, Fast FullSubNet processes sub-band speech spectra in the mel-frequency domain by using cascaded linear-to-mel full-band, sub-band, and mel-to-linear full-band models such that frequencies involved in the sub-band computation are vastly reduced. After that, a down-sampling operation is proposed for the sub-band input sequence to further reduce the computational complexity along the time axis. Experimental results show that, compared to FullSubNet, Fast FullSubNet has only 13\% computational complexity and 16\% processing time, and achieves comparable or even better performance. Code and audio samples are available at https://github.com/Audio-WestlakeU/FullSubNet.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑