arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.04832cs.LG
收藏

HyperSINDy:非线性随机控制方程的深度生成建模

HyperSINDy: Deep Generative Modeling of Nonlinear Stochastic Governing Equations

Harvard University(哈佛大学);University of Washington(华盛顿大学);Allen Institute(艾伦研究所)

Mozes Jacobs, Bingni W. Brunton, Steven L. Brunton, J. Nathan Kutz, Ryan V. Raut

AI总结:

针对现有随机动力学方程发现方法受维数灾难制约的问题,提出HyperSINDy框架,结合变分编码器、超网络与可训练二值掩码实现稀疏随机控制方程的深度生成建模,可准确恢复真实方程并支持高维系统的不确定性量化。

摘要:

从数据中发现控制微分方程是机器学习领域的一个开放前沿方向。非线性动力学稀疏辨识(SINDy)框架能够以稀疏、确定性控制律的形式,通过数据驱动发现可解释模型。近期已有研究尝试将该方法适配到随机场景,但这些适配工作受维数灾难的严重制约。另一方面,受贝叶斯启发的深度学习方法凭借计算高效的近似推理技术,在高维概率建模中取得了广泛成功,这表明可将这类技术用于高效的随机方程发现。本文提出HyperSINDy框架,通过对稀疏控制方程构建深度生成模型来建模随机动力学,其参数化形式可从数据中习得。HyperSINDy采用变分编码器来近似观测状态与导数的分布,超网络(hypernetwork)将该分布的样本转换为微分方程的系数,同时借助可训练二值掩码同步学习微分方程的稀疏形式。训练完成后,HyperSINDy通过系数由高斯白噪声驱动的微分方程生成随机动力学。实验中,HyperSINDy能够准确恢复真实的随机控制方程,其习得的随机性可缩放至与数据的随机性相匹配。最后,HyperSINDy还提供了可扩展至高维系统的不确定性量化能力。综上,HyperSINDy将稀疏方程发现方法与统计机器学习、深度生成建模的前沿进展相结合,为真实系统的模型发现与不确定性量化提供了一个极具前景的框架。

英文摘要:

The discovery of governing differential equations from data is an open frontier in machine learning. The sparse identification of nonlinear dynamics (SINDy) \citep{brunton_discovering_2016} framework enables data-driven discovery of interpretable models in the form of sparse, deterministic governing laws. Recent works have sought to adapt this approach to the stochastic setting, though these adaptations are severely hampered by the curse of dimensionality. On the other hand, Bayesian-inspired deep learning methods have achieved widespread success in high-dimensional probabilistic modeling via computationally efficient approximate inference techniques, suggesting the use of these techniques for efficient stochastic equation discovery. Here, we introduce HyperSINDy, a framework for modeling stochastic dynamics via a deep generative model of sparse governing equations whose parametric form is discovered from data. HyperSINDy employs a variational encoder to approximate the distribution of observed states and derivatives. A hypernetwork \citep{ha_hypernetworks_2016} transforms samples from this distribution into the coefficients of a differential equation whose sparse form is learned simultaneously using a trainable binary mask \citep{louizos_learning_2018}. Once trained, HyperSINDy generates stochastic dynamics via a differential equation whose coefficients are driven by a Gaussian white noise. In experiments, HyperSINDy accurately recovers ground truth stochastic governing equations, with learned stochasticity scaling to match that of the data. Finally, HyperSINDy provides uncertainty quantification that scales to high-dimensional systems. Taken together, HyperSINDy offers a promising framework for model discovery and uncertainty quantification in real-world systems, integrating sparse equation discovery methods with advances in statistical machine learning and deep generative modeling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑