STFNets:基于短时傅立叶神经网络的时频感知信号学习
STFNets: Learning Sensing Signals from the Time-Frequency Perspective with Short-Time Fourier Neural Networks
摘要:
深度学习的最新进展推动了深度神经网络在物联网(IoT)应用中的使用。这些网络是在人类大脑中的信号处理之后建模的,从而在视觉和语音识别等感知任务中产生了显着的优势。然而,物联网应用程序通常测量物理现象,其中底层物理(如惯性,无线信号传播或振荡的自然频率)基本上是信号频率的函数,在频域中提供更好的功能。这一观察结果引出了一个根本性的问题:对于物联网应用,能否开发一种新的神经网络结构,这种结构不仅能综合人类感知生物学的灵感,还能综合物理学的基本性质?因此,在本文中,代替使用传统的构建块(例如,卷积层和递归层),我们提出了一个新的基础神经网络构建块,短时傅立叶神经网络(STFNet)。它将广泛使用的时频分析方法短时傅立叶变换集成到数据处理中,以直接在频域中学习特征,其中潜在现象的物理学留下更好的足迹。STFNet通过提供频谱兼容的新型非线性可学习操作,为时频分析带来了额外的灵活性。此外,STFNets表明,将信号转换到与底层物理学更相关的域可以大大简化学习过程。我们通过大量的实验证明了STFNets的有效性。STFNet在所有实验中的表现都明显优于最先进的深度学习模型。因此,STFNet作为物联网应用的深度神经网络的基本构建块,为各种传感器输入展示了卓越的能力。
英文摘要:
Recent advances in deep learning motivate the use of deep neural networks in Internet-of-Things (IoT) applications. These networks are modelled after signal processing in the human brain, thereby leading to significant advantages at perceptual tasks such as vision and speech recognition. IoT applications, however, often measure physical phenomena, where the underlying physics (such as inertia, wireless signal propagation, or the natural frequency of oscillation) are fundamentally a function of signal frequencies, offering better features in the frequency domain. This observation leads to a fundamental question: For IoT applications, can one develop a new brand of neural network structures that synthesize features inspired not only by the biology of human perception but also by the fundamental nature of physics? Hence, in this paper, instead of using conventional building blocks (e.g., convolutional and recurrent layers), we propose a new foundational neural network building block, the Short-Time Fourier Neural Network (STFNet). It integrates a widely-used time-frequency analysis method, the Short-Time Fourier Transform, into data processing to learn features directly in the frequency domain, where the physics of underlying phenomena leave better foot-prints. STFNets bring additional flexibility to time-frequency analysis by offering novel nonlinear learnable operations that are spectral-compatible. Moreover, STFNets show that transforming signals to a domain that is more connected to the underlying physics greatly simplifies the learning process. We demonstrate the effectiveness of STFNets with extensive experiments. STFNets significantly outperform the state-of-the-art deep learning models in all experiments. A STFNet, therefore, demonstrates superior capability as the fundamental building block of deep neural networks for IoT applications for various sensor inputs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。