基于贝叶斯模型选择的演化方程稀疏辨识
Sparse identification of evolution equations via Bayesian model selection
AI总结:
本文提出一种基于贝叶斯优化和Wasserstein度量的稀疏辨识方法,用于从数据中推断非线性动力系统演化方程,并在尾流和fMRI数据上验证了其精度与可解释性。
摘要:
演化方程的定量表述是跨多个科学领域对动力系统进行预测、控制和理解的基石。除了基于基本科学推理或先验知识推导动力系统的微分方程之外,近年来,纯粹从数据中推断这些方程的兴趣日益增长。在本文中,我们基于对时间导数质量和采样率这两个关键挑战如何影响该问题的观察,提出了一种从观测数据中稀疏辨识非线性动力系统的新方法。我们的方法将基于阈值最小二乘最小化的系统辨识与额外的误差度量相结合,这些误差度量同时考虑了模型与数据时间导数之间的偏差,以及模型在预测动力学方面的综合表现。具体而言,我们整合了最小二乘误差以及用于估计模型的Wasserstein度量,并将它们结合在一个贝叶斯优化框架内,以高效地确定用于阈值处理和不同误差范数加权的最优超参数。此外,我们对系统中的每个微分方程采用不同的正则化参数,从而提高了该方法的精度和灵活性。我们通过将方法应用于动态fMRI数据以及圆柱体后尾流的典型示例来展示其能力。在尾流问题中,我们的方法辨识出一个稀疏且精确的模型,该模型能够正确捕捉瞬态动力学、振荡周期和相位信息,性能优于现有方法。在fMRI示例中,我们展示了我们的方法如何从训练好的循环神经网络中提取见解,通过推断能够捕捉潜在因果关系的微分方程,为可解释人工智能提供了一条新途径。
英文摘要:
The quantitative formulation of evolution equations is the backbone for prediction, control, and understanding of dynamical systems across diverse scientific fields. Besides deriving differential equations for dynamical systems based on basic scientific reasoning or prior knowledge in recent times a growing interest emerged to infer these equations purely from data. In this article, we introduce a novel method for the sparse identification of nonlinear dynamical systems from observational data, based on the observation how the key challenges of the quality of time derivatives and sampling rates influence this problem. Our approach combines system identification based on thresholded least squares minimization with additional error measures that account for both the deviation between the model and the time derivative of the data, and the integrated performance of the model in forecasting dynamics. Specifically, we integrate a least squares error as well as the Wasserstein metric for estimated models and combine them within a Bayesian optimization framework to efficiently determine optimal hyperparameters for thresholding and weighting of the different error norms. Additionally, we employ distinct regularization parameters for each differential equation in the system, enhancing the method's precision and flexibility. We demonstrate the capabilities of our approach through applications to dynamical fMRI data and the prototypical example of a wake flow behind a cylinder. In the wake flow problem, our method identifies a sparse, accurate model that correctly captures transient dynamics, oscillation periods, and phase information, outperforming existing methods. In the fMRI example, we show how our approach extracts insights from a trained recurrent neural network, offering a novel avenue for explainable AI by inferring differential equations that capture potentially causal relationships.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。