arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.14639eess.ASeess.SP
收藏

SyncNet:用于音频信号时延估计的相关性目标函数

SyncNet: correlating objective for time delay estimation in audio signals

Akshay Raina, Vipul Arora

AI总结:

本文提出SyncNet,通过基于相关函数的新型目标函数训练深度神经网络,将音频信号变换为在真实时延处高互相关的序列,从而在噪声混响环境下实现鲁棒时延估计。

摘要:

本研究解决在噪声和混响环境中对信号执行鲁棒且可靠的时间延迟估计的任务。与流行的基于信号处理的方法不同,本文提出利用深度神经网络将输入信号变换为另一对序列,这对序列在真实时间延迟处表现出较高的互相关性。这一目标借助一种新颖的、基于相关函数的目标函数来训练网络而实现。所提方法还具有内在可解释性,因为它不会丢失时间信息。研究针对脉冲、语音和音乐节拍等不同类型音频信号的相互时间延迟估计进行了实验评估。SyncNet优于GCC-PHAT等其他经典方法以及一些其他基于学习的方法。

英文摘要:

This study addresses the task of performing robust and reliable time-delay estimation in signals in noisy and reverberating environments. In contrast to the popular signal processing based methods, this paper proposes to transform the input signals using a deep neural network into another pair of sequences which show high cross correlation at the actual time delay. This is achieved with the help of a novel correlation function based objective function for training the network. The proposed approach is also intrinsically interpretable as it does not lose temporal information. Experimental evaluations are performed for estimating mutual time delays for different types of audio signals such as pulse, speech and musical beats. SyncNet outperforms other classical approaches, such as GCC-PHAT, and some other learning based approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑