arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.05783cs.LG
收藏

ConCerNet:一种用于自动守恒律发现与可信动力系统预测的基于对比学习的框架

ConCerNet: A Contrastive Learning Based Framework for Automated Conservation Law Discovery and Trustworthy Dynamical System Prediction

Massachusetts Institute of Technology(麻省理工学院);University of California, San Diego(加州大学圣地亚哥分校);MIT-IBM Watson AI Lab(麻省理工-IBM沃森人工智能实验室);IBM Research(IBM研究院);Thomas J. Watson Research Center(托马斯·J·沃森研究中心)

Wang Zhang, Tsui-Wei Weng, Subhro Das, Alexandre Megretski, Luca Daniel, Lam M. Nguyen

AI总结:

针对深度神经网络建模动力系统时不遵守守恒律等物理约束的问题,提出含对比学习自动发现守恒律、神经投影层保证不变性的ConCerNet框架,理论证明隐表示与不变函数的关系,实验效果优于基线且可扩展至复杂大规模系统。

摘要:

深度神经网络(DNN)已展现出强大的动力系统建模能力,但它们通常不遵守守恒律等物理约束。本文提出了一种名为ConCerNet的新型学习框架,旨在提升基于DNN的动力学建模的可信度,使其具备不变性属性。ConCerNet包含两个步骤:(i)一种对比学习方法,用于从轨迹观测中自动捕捉系统不变量(即守恒特性);(ii)一个神经投影层,用于确保学习到的动力学模型保持所学到的不变量。我们从理论上证明了学习到的隐表示与未知系统不变函数之间的函数关系。实验表明,我们的方法在坐标误差和守恒指标上均大幅优于基线神经网络。凭借基于神经网络的参数化且不依赖先验知识的特性,我们的方法可通过自编码器扩展至复杂大规模动力学系统。

英文摘要:

Deep neural networks (DNN) have shown great capacity of modeling a dynamical system; nevertheless, they usually do not obey physics constraints such as conservation laws. This paper proposes a new learning framework named ConCerNet to improve the trustworthiness of the DNN based dynamics modeling to endow the invariant properties. ConCerNet consists of two steps: (i) a contrastive learning method to automatically capture the system invariants (i.e. conservation properties) along the trajectory observations; (ii) a neural projection layer to guarantee that the learned dynamics models preserve the learned invariants. We theoretically prove the functional relationship between the learned latent representation and the unknown system invariant function. Experiments show that our method consistently outperforms the baseline neural networks in both coordinate error and conservation metrics by a large margin. With neural network based parameterization and no dependence on prior knowledge, our method can be extended to complex and large-scale dynamics by leveraging an autoencoder.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑