arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.05967cs.LGmath.DSmath.OC
收藏

关于 reservoir computing 网络中的主导流形

On Dominant Manifolds in Reservoir Computing Networks

Cornell University(康奈尔大学);University of British Columbia(不列颠哥伦比亚大学)

Noa Kaplan, Alberto Padoan, Anastasia Bizyaeva

AI总结:

研究了 reservoir computing 网络在时间预测任务中训练过程中低维主导流形的形成,揭示了主导模式与训练数据内在维度和信息含量的关系,并探讨了非线性 reservoir computing 的泛化方法。

摘要:

理解训练如何塑造递归网络动态的几何结构是时间序列建模中的核心问题。我们研究了 reservoir computing (RC) 网络在时间预测任务中训练过程中低维主导流形的出现。对于一个简化线性和连续时间 reservoir 模型,我们将主导模式的维度和结构直接与训练数据的内在维度和信息含量联系起来。特别是,对于由自主动态系统生成的训练数据,我们将训练后的 reservoir 的主导模式与原始系统的 Koopman 特征函数近似联系起来,阐明了 reservoir computing 与动态模式分解算法之间的显式联系。我们通过模拟展示了训练过程中生成主导流形的本征值运动,并讨论了通过切线动力学和微分 p-主导性推广到非线性 RC 的方法。

英文摘要:

Understanding how training shapes the geometry of recurrent network dynamics is a central problem in time-series modeling. We study the emergence of low-dimensional dominant manifolds in the training of Reservoir Computing (RC) networks for temporal forecasting tasks. For a general linear continuous-time reservoir in the infinite-data limit, we show that the training data generate an invariant subspace of the trained reservoir, whose dimension equals the number of dominant modes. We then specialize to a simplified diagonal linear reservoir, where we link the dominant eigenvalues and eigenvectors to the spectrum of a backward Dynamic Mode Decomposition matrix, which yields a finite-dimensional approximation of the backward-time Koopman operator of the system generating the training data. We illustrate the emergence of these dominant modes during training in simulation, and discuss how the analysis may be extended to nonlinear RC via tangent dynamics and differential p-dominance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑