arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.02420eess.AScs.LGcs.SD
收藏

用于说话人提取的空间选择性深度非线性滤波器

Spatially Selective Deep Non-linear Filters for Speaker Extraction

Kristina Tesch, Timo Gerkmann

AI总结:

针对多人同时说话场景,提出一种深度联合空间-谱非线性滤波器,通过基于目标方向设置循环层初始状态的条件化机制,实现任意方向引导,在无性能损失下提升灵活性,并可用于语音分离与多说话人定位。

摘要:

在多人同时说话的场景中,信号的空间特征是提取目标信号的最显著特征。在这项工作中,我们开发了一种深度联合空间-谱非线性滤波器,该滤波器可以在任意目标方向上进行引导。为此,我们提出了一种简单有效的条件化机制,该机制根据目标方向设置滤波器循环层的初始状态。我们表明,该方案比基线方法更有效,并且在无性能损失的情况下提高了滤波器的灵活性。由此产生的空间选择性非线性滤波器也可用于任意数量说话人的语音分离,并如我们在本文中所展示的,实现非常精确的多说话人定位。

英文摘要:

In a scenario with multiple persons talking simultaneously, the spatial characteristics of the signals are the most distinct feature for extracting the target signal. In this work, we develop a deep joint spatial-spectral non-linear filter that can be steered in an arbitrary target direction. For this we propose a simple and effective conditioning mechanism, which sets the initial state of the filter's recurrent layers based on the target direction. We show that this scheme is more effective than the baseline approach and increases the flexibility of the filter at no performance cost. The resulting spatially selective non-linear filters can also be used for speech separation of an arbitrary number of speakers and enable very accurate multi-speaker localization as we demonstrate in this paper.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑