arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1703.07172cs.SD
收藏

基于多目标学习和掩码的深度神经网络语音增强后处理

Multi-Objective Learning and Mask-Based Post-Processing for Deep Neural Network Based Speech Enhancement

Georgia Tech(佐治亚理工学院)

Yong Xu, Jun Du, Zhen Huang, Li-Rong Dai, Chin-Hui Lee

摘要:

我们提出了一个多目标的框架来学习两个次要目标不直接相关的预期任务的语音增强(SE)和清洁的对数功率谱(LPS)功能的主要目标直接用于构建增强的语音信号。在基于SE的深度神经网络(DNN)中,我们引入了一个辅助结构来学习二级连续特征(如梅尔频率倒谱系数(MFCC))和分类信息(如理想二进制掩码(IBM)),并将其集成到原始DNN架构中,以联合优化所有参数。这种联合估计方案施加了在LPS的直接预测中不可用的附加约束,并且潜在地改善了对主要目标的学习。此外,作为副产品的所学习的次要信息可以用于其他目的,例如,基于IBM的后处理在这项工作中。实验结果表明,LPS和MFCC联合学习提高了SE性能,基于IBM的后处理进一步提高了重建语音的听音质量。

英文摘要:

We propose a multi-objective framework to learn both secondary targets not directly related to the intended task of speech enhancement (SE) and the primary target of the clean log-power spectra (LPS) features to be used directly for constructing the enhanced speech signals. In deep neural network (DNN) based SE we introduce an auxiliary structure to learn secondary continuous features, such as mel-frequency cepstral coefficients (MFCCs), and categorical information, such as the ideal binary mask (IBM), and integrate it into the original DNN architecture for joint optimization of all the parameters. This joint estimation scheme imposes additional constraints not available in the direct prediction of LPS, and potentially improves the learning of the primary target. Furthermore, the learned secondary information as a byproduct can be used for other purposes, e.g., the IBM-based post-processing in this work. A series of experiments show that joint LPS and MFCC learning improves the SE performance, and IBM-based post-processing further enhances listening quality of the reconstructed speech.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑