arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.06217eess.AS
收藏

选择性状态空间模型用于单声道语音增强

Selective State Space Model for Monaural Speech Enhancement

Moran Chen, Qiquan Zhang, Mingjiang Wang, Xiangyu Zhang, Hexin Liu, Eliathamby Ambikairaiah, Deying Chen

AI总结:

本文提出混合卷积-Mamba骨干网络MambaDC,结合局部与全局建模,在语音增强中优于Transformer、Conformer及标准Mamba,实现高效长距离建模。

摘要:

语音用户界面(VUIs)通过语音命令促进了人与机器之间的高效交互。由于真实世界的声学场景复杂,语音增强对于鲁棒的VUI至关重要。Transformer及其变体(如Conformer)在语音增强中展示了顶尖的结果。然而,它们都面临与序列长度相关的二次方计算复杂度问题,这阻碍了它们处理长序列的能力。最近,一种名为Mamba的新型状态空间模型,以其线性复杂度处理长序列的强大能力,为应对这一挑战提供了解决方案。在本文中,我们提出了一种新颖的混合卷积-Mamba骨干网络,称为MambaDC,用于语音增强。我们的MambaDC结合了卷积网络建模局部交互的优势和Mamba建模长距离全局依赖的能力。我们在基础和最先进的(SoTA)语音增强框架内,针对两种常用的训练目标进行了全面实验。结果表明,MambaDC在所有训练目标上均优于Transformer、Conformer和标准Mamba。基于当前先进框架,使用MambaDC骨干网络展现的结果优于现有的SoTA系统。这为语音增强中的高效长距离全局建模奠定了基础。

英文摘要:

Voice user interfaces (VUIs) have facilitated the efficient interactions between humans and machines through spoken commands. Since real-word acoustic scenes are complex, speech enhancement plays a critical role for robust VUI. Transformer and its variants, such as Conformer, have demonstrated cutting-edge results in speech enhancement. However, both of them suffers from the quadratic computational complexity with respect to the sequence length, which hampers their ability to handle long sequences. Recently a novel State Space Model called Mamba, which shows strong capability to handle long sequences with linear complexity, offers a solution to address this challenge. In this paper, we propose a novel hybrid convolution-Mamba backbone, denoted as MambaDC, for speech enhancement. Our MambaDC marries the benefits of convolutional networks to model the local interactions and Mamba's ability for modeling long-range global dependencies. We conduct comprehensive experiments within both basic and state-of-the-art (SoTA) speech enhancement frameworks, on two commonly used training targets. The results demonstrate that MambaDC outperforms Transformer, Conformer, and the standard Mamba across all training targets. Built upon the current advanced framework, the use of MambaDC backbone showcases superior results compared to existing \textcolor{black}{SoTA} systems. This sets the stage for efficient long-range global modeling in speech enhancement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑