arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.12940nlin.CDcs.LG
收藏

关于数据驱动时间演化预测中 Koopman 算子近似与神经常微分方程之间关系的研究

On the relationship between Koopman operator approximations and neural ordinary differential equations for data-driven time-evolution predictions

University of Wisconsin-Madison(威斯康星大学麦迪逊分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Jake Buzhardt, C. Ricardo Constante-Amores, Michael D. Graham

AI总结:

本文揭示带状态空间投影的 EDMD-DL 与神经 ODE 在非线性动力系统时间演化建模中的结构等价性,并通过混沌与湍流实验验证其预测性能相当。

摘要:

本工作探讨了用于预测非线性动力系统时间演化的状态空间方法与基于 Koopman 算子的方法之间的关系。我们证明,带有字典学习的扩展动态模态分解(EDMD-DL)在与状态空间投影相结合时,等价于状态空间上非线性离散时间流映射的一种神经网络表示。我们强调该投影步骤如何将非线性引入演化方程,从而显著改善 EDMD-DL 预测。借助这一投影,EDMD-DL 在状态空间上导出一个非线性动力系统,该系统可以用离散时间或连续时间表示。该系统具有适合神经网络的自然结构:状态首先被扩展到高维特征空间,随后进行线性映射,该映射将离散时间映射或向量场表示为这些特征的线性组合。受这些观察启发,我们实现了神经常微分方程(ODE)与 EDMD-DL 的若干变体,这些变体通过组合二者各自模型结构和训练过程的不同方面而开发。我们利用 Lorenz 系统中的混沌动力学以及湍流剪切流的九模态模型进行数值实验来评估这些方法,结果表明各方法在短时轨迹预测、长时间统计量重构和稀有事件预测方面具有相当的性能。这些结果突出表明,带状态空间投影的 EDMD-DL 实现与动力学的神经 ODE 表示具有等价性。我们还表明,在极端事件预测方面,这些方法与一种非马尔可夫方法提供了相当的性能。

英文摘要:

This work explores the relationship between state space methods and Koopman operator-based methods for predicting the time-evolution of nonlinear dynamical systems. We demonstrate that extended dynamic mode decomposition with dictionary learning (EDMD-DL), when combined with a state space projection, is equivalent to a neural network representation of the nonlinear discrete-time flow map on the state space. We highlight how this projection step introduces nonlinearity into the evolution equations, enabling significantly improved EDMD-DL predictions. With this projection, EDMD-DL leads to a nonlinear dynamical system on the state space, which can be represented in either discrete or continuous time. This system has a natural structure for neural networks, where the state is first expanded into a high dimensional feature space followed by a linear mapping which represents the discrete-time map or the vector field as a linear combination of these features. Inspired by these observations, we implement several variations of neural ordinary differential equations (ODEs) and EDMD-DL, developed by combining different aspects of their respective model structures and training procedures. We evaluate these methods using numerical experiments on chaotic dynamics in the Lorenz system and a nine-mode model of turbulent shear flow, showing comparable performance across methods in terms of short-time trajectory prediction, reconstruction of long-time statistics, and prediction of rare events. These results highlight the equivalence of the EDMD-DL implementation with a state space projection to a neural ODE representation of the dynamics. We also show that these methods provide comparable performance to a non-Markovian approach in terms of prediction of extreme events.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑