arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.18705eess.AScs.AIcs.SDeess.SP
收藏

语音增强:面向TWS耳塞的低延迟实时语音增强

Speech Boosting: Low-Latency Live Speech Enhancement for TWS Earbuds

Samsung Research(三星研究院)

Hanbin Bae, Pavel Andreev, Azat Saginbaev, Nicholas Babaev, Won-Jun Lee, Hosang Sung, Hoon-Young Cho

AI总结:

本文提出一种面向TWS耳塞端侧的低延迟语音增强方案,通过优化网络架构、损失函数、剪枝及硬件适配,在ANC开启的噪声对话场景下实现低于3毫秒延迟并显著提升增强质量。

摘要:

本文介绍了一种专为真无线立体声(TWS)耳塞端侧使用而定制的语音增强解决方案。该方案专门设计用于在嘈杂环境中支持对话,并启用主动降噪(ANC)。在此场景下,语音增强模型面临的主要挑战源于限制端侧使用的计算复杂度,以及必须小于3毫秒以保持实时对话的延迟。为解决这些问题,我们评估了若干关键设计要素,包括网络架构与域、损失函数设计、剪枝方法以及硬件特定优化。结果表明,与基线模型相比,我们在语音增强质量上取得了显著提升,同时降低了计算复杂度和算法延迟。

英文摘要:

This paper introduces a speech enhancement solution tailored for true wireless stereo (TWS) earbuds on-device usage. The solution was specifically designed to support conversations in noisy environments, with active noise cancellation (ANC) activated. The primary challenges for speech enhancement models in this context arise from computational complexity that limits on-device usage and latency that must be less than 3 ms to preserve a live conversation. To address these issues, we evaluated several crucial design elements, including the network architecture and domain, design of loss functions, pruning method, and hardware-specific optimization. Consequently, we demonstrated substantial improvements in speech enhancement quality compared with that in baseline models, while simultaneously reducing the computational complexity and algorithmic latency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑