arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.07032cs.SDcs.LGcs.SYeess.ASeess.SY
收藏

神经和声机:用于非线性动态系统辨识的可解释深度结构及其在音频处理中的应用

Neural Harmonium: An Interpretable Deep Structure for Nonlinear Dynamic System Identification with Application to Audio Processing

Amazon Web Services, Inc.(亚马逊云科技有限公司)

Karim Helwani, Erfan Soltanmohammadi, Michael M. Goodwin

AI总结:

本文提出一种因果可解释的深度结构(神经和声机),在时频域建模动态系统,采用阶递归二阶优化与神经网络识别频率依赖,在声学回声消除中验证了其有效性。

摘要:

近年来,提高深度神经网络的可解释性受到越来越多的关注,尤其是在利用深度学习解决物理学问题时。可解释性有助于我们理解模型的泛化能力并揭示其局限性。本文提出了一种用于动态系统建模的因果可解释深度结构。所提出的模型利用谐波分析,在时频域中建模系统,同时保持高时间和频谱分辨率。此外,该模型以阶递归方式构建,允许快速、稳健且精确的二阶优化,而无需显式计算Hessian矩阵。为规避系统构建模块带来的高维性问题,设计了一个神经网络来识别频率间的相互依赖关系。所提出的模型在音频信号处理任务所需的非线性系统辨识问题上进行了展示和验证。在声学回声消除场景中,通过众包实验将所提方法与最新技术解决方案进行对比,证实了该方法在实际应用中的有效性。

英文摘要:

Improving the interpretability of deep neural networks has recently gained increased attention, especially when the power of deep learning is leveraged to solve problems in physics. Interpretability helps us understand a model's ability to generalize and reveal its limitations. In this paper, we introduce a causal interpretable deep structure for modeling dynamic systems. Our proposed model makes use of the harmonic analysis by modeling the system in a time-frequency domain while maintaining high temporal and spectral resolution. Moreover, the model is built in an order recursive manner which allows for fast, robust, and exact second order optimization without the need for an explicit Hessian calculation. To circumvent the resulting high dimensionality of the building blocks of our system, a neural network is designed to identify the frequency interdependencies. The proposed model is illustrated and validated on nonlinear system identification problems as required for audio signal processing tasks. Crowd-sourced experimentation contrasting the performance of the proposed approach to other state-of-the-art solutions on an acoustic echo cancellation scenario confirms the effectiveness of our method for real-life applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑