arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1904.03006eess.AScs.SD
收藏

基于谱源模型和深度神经网络的目标声源鲁棒双耳定位

Robust Binaural Localization of a Target Sound Source by Combining Spectral Source Models and Deep Neural Networks

University of Sheffield(谢菲尔德大学);University of Malaga(马拉加大学)

Ning Ma, Jose A. Gonzalez, Guy J. Brown

摘要:

尽管有明确的证据表明自上而下(例如,注意力)在生物空间听觉中的影响,相对较少的机器听觉系统在声音定位中利用自顶向下的基于模型的知识。本文通过提出一种新的双耳声音定位框架来解决这个问题,该框架结合了关于声源频谱特性的基于模型的信息和深度神经网络(DNN)。首先在训练阶段期间使用从声音信号分离地提取的频谱特征来估计目标源模型和背景源模型。当背景源的身份不可用时,可以使用通用背景模型。在测试过程中,源模型被联合使用来解释混合观测,并通过选择性地加权基于DNN的定位系统输出的源方位后验来改善定位过程。为了解决训练和测试之间可能的不匹配,在测试期间进一步采用模型自适应过程,其以迭代方式直接从噪声观测中调整背景模型参数。因此,拟议的系统结合了基于模型和数据驱动的信息流在一个单一的计算框架。评估任务涉及在存在干扰源和室内混响的情况下定位目标语音源。我们的实验表明,通过利用基于模型的信息,以这种方式,声音定位性能可以大大提高各种噪声和混响条件下。

英文摘要:

Despite there being clear evidence for top-down (e.g., attentional) effects in biological spatial hearing, relatively few machine hearing systems exploit top-down model-based knowledge in sound localisation. This paper addresses this issue by proposing a novel framework for binaural sound localisation that combines model-based information about the spectral characteristics of sound sources and deep neural networks (DNNs). A target source model and a background source model are first estimated during a training phase using spectral features extracted from sound signals in isolation. When the identity of the background source is not available, a universal background model can be used. During testing, the source models are used jointly to explain the mixed observations and improve the localisation process by selectively weighting source azimuth posteriors output by a DNN-based localisation system. To address the possible mismatch between training and testing, a model adaptation process is further employed on-the-fly during testing, which adapts the background model parameters directly from the noisy observations in an iterative manner. The proposed system therefore combines model-based and data-driven information flow within a single computational framework. The evaluation task involved localisation of a target speech source in the presence of an interfering source and room reverberation. Our experiments show that by exploiting model-based information in this way, sound localisation performance can be improved substantially under various noisy and reverberant conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑