arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.10494eess.AScs.SD
收藏

跨频谱域中用于实时语音增强的两阶段框架

A Two-Stage Framework in Cross-Spectrum Domain for Real-Time Speech Enhancement

Shanghai Jiao Tong University(上海交通大学);Tencent Video Cloud(腾讯云视频)

Yuewei Zhang, Huanbin Zou, Jie Zhu

AI总结:

本文提出跨频谱域两阶段框架 FDFNet,在 STFT 域增强幅度后于 STDCT 域处理复数谱,以更高效地抑制噪声并恢复相位,实验性能优于已有两阶段及先进语音增强系统。

摘要:

两阶段流水线因其相较于传统单阶段方法的优势而在语音增强任务中广受欢迎。当前的两阶段方法通常在第一阶段增强幅度谱,并在第二阶段进一步修改复数谱,以抑制残余噪声并恢复语音相位。上述整个过程都在短时傅里叶变换(STFT)频谱域中执行。本文中,我们在短时离散余弦变换(STDCT)频谱域中重新实现上述第二个子过程。原因在于,我们发现 STDCT 表现出比 STFT 更强的噪声抑制能力。此外,STDCT 的隐式相位确保了更简单、更高效的相位恢复,而在基于 STFT 的方法中,相位恢复既具有挑战性又计算昂贵。因此,我们提出了一种新颖的两阶段框架,称为 STFT-STDCT 频谱融合网络(FDFNet),用于跨频谱域的语音增强。实验结果表明,所提出的 FDFNet 优于以往的两阶段方法,并且与其他先进系统相比也表现出优越的性能。

英文摘要:

Two-stage pipeline is popular in speech enhancement tasks due to its superiority over traditional single-stage methods. The current two-stage approaches usually enhance the magnitude spectrum in the first stage, and further modify the complex spectrum to suppress the residual noise and recover the speech phase in the second stage. The above whole process is performed in the short-time Fourier transform (STFT) spectrum domain. In this paper, we re-implement the above second sub-process in the short-time discrete cosine transform (STDCT) spectrum domain. The reason is that we have found STDCT performs greater noise suppression capability than STFT. Additionally, the implicit phase of STDCT ensures simpler and more efficient phase recovery, which is challenging and computationally expensive in the STFT-based methods. Therefore, we propose a novel two-stage framework called the STFT-STDCT spectrum fusion network (FDFNet) for speech enhancement in cross-spectrum domain. Experimental results demonstrate that the proposed FDFNet outperforms the previous two-stage methods and also exhibits superior performance compared to other advanced systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑