arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.12982eess.AS
收藏

面向实时区域声源分离的推理自适应神经转向技术

Inference-Adaptive Neural Steering for Real-Time Area-Based Sound Source Separation

Martin Strauss, Wolfgang Mack, María Luis Valero, Okan Köpüklü

AI总结:

本文提出一种推理自适应神经转向技术,通过对麦克风信号施加相移,在无需重新训练DNN的情况下实时调整声源分离目标区域,其性能与针对新区域显式训练的DNN相当。

摘要:

我们提出了一种新颖的神经转向技术,该技术在推理过程中自适应地调整空间感知多麦克风声源分离算法的目标区域,而无需重新训练深度神经网络(DNN)。为实现这一目标,我们首先训练一个DNN,旨在保留由角度跨度定义的目标区域内的语音,同时抑制来自其他方向的声源。随后,对麦克风信号施加相移,使我们能够在推理过程中以可忽略不计的额外计算复杂度移动目标区域的中心。此外,我们表明,所提出的方法在多种声学场景中表现良好,包括目标区域内外多个说话人以及额外噪声。更准确地说,就DNSMOS和SI-SDR而言,所提出的方法与针对转向后目标区域显式训练的DNN性能相当。

英文摘要:

We propose a novel Neural Steering technique that adapts the target area of a spatial-aware multi-microphone sound source separation algorithm during inference without the necessity of retraining the deep neural network (DNN). To achieve this, we first train a DNN aiming to retain speech within a target region, defined by an angular span, while suppressing sound sources stemming from other directions. Afterward, a phase shift is applied to the microphone signals, allowing us to shift the center of the target area during inference at negligible additional cost in computational complexity. Further, we show that the proposed approach performs well in a wide variety of acoustic scenarios, including several speakers inside and outside the target area and additional noise. More precisely, the proposed approach performs on par with DNNs trained explicitly for the steered target area in terms of DNSMOS and SI-SDR.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑