Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us understand and predict the behavior of complex dynamic systems. Although extensive work has recently been done in this field, robustly distilling explicit model forms from very sparse data with considerable noise remains intractable. Moreover, quantifying and propagating the uncertainty of the identified system from noisy data is challenging, and relevant literature is still limited. To bridge this gap, we develop a novel Bayesian spline learning framework to identify parsimonious governing equations of nonlinear (spatio)temporal dynamics from sparse, noisy data with quantified uncertainty. The proposed method utilizes spline basis to handle the data scarcity and measurement noise, upon which a group of derivatives can be accurately computed to form a library of candidate model terms. The equation residuals are used to inform the spline learning in a Bayesian manner, where approximate Bayesian uncertainty calibration techniques are employed to approximate posterior distributions of the trainable parameters. To promote the sparsity, an iterative sequential-threshold Bayesian learning approach is developed, using the alternative direction optimization strategy to systematically approximate L0 sparsity constraints. The proposed algorithm is evaluated on multiple nonlinear dynamical systems governed by canonical ordinary and partial differential equations, and the merit/superiority of the proposed method is demonstrated by comparison with state-of-the-art methods.
Machine Learning Discovery of Optimal Quadrature Rules for Isogeometric Analysis
BCAM – Basque Center for Applied Mathematics(巴斯克应用数学中心(BCAM));CUNEF University(CUNEF大学);University of the Basque Country (UPV/EHU)(巴斯克大学(UPV/EHU));Ikerbasque – Basque Foundation for Sciences(巴斯克科学基金会(Ikerbasque))
Frugal Bayesian Optimization: Scalable Surrogates for Data- and Resource-Limited Discovery
National Centre for Scientific Research "Demokritos"(希腊德谟克利特国家科学研究中心);University of Patras(帕特雷大学);National and Kapodistrian University of Athens(雅典国立卡波迪斯特里亚大学);Hellenic Mediterranean University(希腊地中海大学);SciFY PNPC
Bayesian differential programming for robust systems identification under uncertainty
University of Pennsylvania(宾夕法尼亚大学)
本文提出了一个机器学习框架,用于从噪声、稀疏和不规则的非线性动态系统的观测中识别贝叶斯系统。该方法利用微分编程的最新发展,通过常微分方程求解器传播梯度信息,并使用Hamilton Monte Carlo对未知模型参数进行贝叶斯推断。这使我们能够有效地推断后验分布与量化的不确定性的似是而非的模型,而稀疏促进先验的使用,使潜在的潜在动态的可解释的和简约的表示发现。一系列的数值研究表明,所提出的方法的有效性,包括非线性振子,捕食-食饵系统,混沌动力学和系统生物学。总之,我们的研究结果提出了一个新的,灵活的和强大的工作流程,数据驱动的模型发现下的不确定性。
Adaptation of uncertainty-penalized Bayesian information criterion for parametric partial differential equation discovery
Graduate School of Information Science and Technology, Osaka University(大阪大学信息科学与技术研究生院);SANKEN (The Institute of Scientific and Industrial Research), Osaka University(大阪大学产业科学研究所(SANKEN))
LLM-PDESR: Robust PDE Discovery via Subdomain Weighted Residuals and LLM-Guided Symbolic Hypothesis Generation
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);School of Big Data and Artificial Intelligence, Guangdong University of Finance and Economics(广东财经大学大数据与人工智能学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University(吉林大学符号计算与知识工程教育部重点实验室);School of Computer Science, Zhuhai College of Science and Technology(珠海科技学院计算机科学学院);Department of Mechanical Engineering, National University of Singapore(新加坡国立大学机械工程系)
Gaussian processes meet NeuralODEs: A Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data
University of Pennsylvania(宾夕法尼亚大学)
本文提出了一个机器学习框架(GP-NODE),用于从非线性动态系统的部分、噪声和不规则观测中识别贝叶斯系统。该方法利用微分编程的最新发展,通过常微分方程求解器传播梯度信息,并使用Hamilton Monte Carlo采样和高斯过程先验对所观察到的系统状态进行贝叶斯推断。这使我们能够利用观测数据中的时间相关性,并有效地推断具有量化不确定性的合理模型的后验分布。此外,使用稀疏促进先验,如芬兰马蹄免费模型参数,使潜在的潜在动态的可解释和简约的表示发现。一系列的数值研究表明,建议的GP-NODE方法的有效性,包括捕食系统,系统生物学,和50维人体运动动力系统。总之,我们的研究结果提出了一种新的,灵活的和强大的工作流程,数据驱动的模型发现下的不确定性。本手稿随附的所有代码和数据可在\url{https://github.com/PredictiveIntelligenceLab/GP-NODEs}在线获取。
Discovering Governing Equations in the Presence of Uncertainty
Ridwan Olabiyi School of Computing and Augmented Intelligence, Arizona State University(Ridwan Olabiyi 计算与增强智能学院,亚利桑那州立大学);Han Hu Department of Mechanical Engineering, University of Arkansas(Han Hu 机械工程系,阿肯色大学);Ashif Iquebal School of Computing and Augmented Intelligence, Arizona State University(Ashif Iquebal 计算与增强智能学院,亚利桑那州立大学)