Can neural networks solve math problems using first a principle alone? This paper shows how to leverage the fundamental theorem of the calculus of variations to design deep neural networks to solve functional optimization without requiring training data (e.g., ground-truth optimal solutions). Our approach is particularly crucial when the solution is a function defined over an unknown interval or support\textemdash such as in minimum-time control problems. By incorporating the necessary conditions satisfied by the optimal function solution, as derived from the calculus of variation, in the design of the deep architecture, CalVNet leverages overparameterized neural networks to learn these optimal functions directly. We validate CalVNet by showing that, without relying on ground-truth data and simply incorporating first principles, it successfully derives the Kalman filter for linear filtering, the bang-bang optimal control for minimum-time problems, and finds geodesics on manifolds. Our results demonstrate that CalVNet can be trained in an unsupervised manner, without relying on ground-truth data, establishing a promising framework for addressing general, potentially unsolved functional optimization problems that still lack analytical solutions.
Stochastic variance reduced extragradient methods for solving hierarchical variational inequalities
Weierstrass Institute for Applied Analysis and Stochastics(魏尔斯特拉斯应用分析与随机学研究所);Mannheim University(曼海姆大学);Technion - Israel Institute of Technology(以色列理工学院)
Solving Statistical Mechanics Using Variational Autoregressive Networks
Peking University(北京大学);Institute of Physics, Chinese Academy of Sciences(中国科学院物理研究所);University of Chinese Academy of Sciences(中国科学院大学);Songshan Lake Materials Laboratory(松山湖材料实验室);Institute of Theoretical Physics, Chinese Academy of Sciences(中国科学院理论物理研究所)
Variational Geometry-aware Neural Network based Method for Solving High-dimensional Diffeomorphic Mapping Problems
Department of Mathematics, The Chinese University of Hong Kong, Shatin, Hong Kong(数学系,香港中文大学(深圳校区));Department of Mathematics, University of British Columbia, Vancouver, V6T1Z2, BC, Canada(数学系,不列颠哥伦比亚大学);Department of Mathematics, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong(数学系,香港中文大学(深圳校区))
CENN: Conservative energy method based on neural networks with subdomains for solving variational problems involving heterogeneous and complex geometries
Tsinghua University(清华大学);Massachusetts Institute of Technology(麻省理工学院);KU Leuven(荷语鲁汶大学)