耗散深层神经动力系统
Dissipative Deep Neural Dynamical Systems
摘要:
本文给出了由深度神经网络参数化的离散动力系统的耗散性和局部渐近稳定性的充分条件。我们利用神经网络的逐点仿射映射的表示,从而暴露其局部线性算子,并使其可用于经典的系统分析和设计方法。这使我们能够通过评估其耗散性,估计其稳定点和状态空间划分来“打开神经动力系统行为的黑匣子”。我们将这些局部线性算子的范数与耗散系统中存储的能量联系起来,耗散系统的供给率由它们的总偏置项表示。经验上,我们分析了这些局部线性算子的动力学行为和特征值谱的变化与不同的权重因子分解,激活函数,偏置项,和深度。
英文摘要:
In this paper, we provide sufficient conditions for dissipativity and local asymptotic stability of discrete-time dynamical systems parametrized by deep neural networks. We leverage the representation of neural networks as pointwise affine maps, thus exposing their local linear operators and making them accessible to classical system analytic and design methods. This allows us to "crack open the black box" of the neural dynamical system's behavior by evaluating their dissipativity, and estimating their stationary points and state-space partitioning. We relate the norms of these local linear operators to the energy stored in the dissipative system with supply rates represented by their aggregate bias terms. Empirically, we analyze the variance in dynamical behavior and eigenvalue spectra of these local linear operators with varying weight factorizations, activation functions, bias terms, and depths.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。