Modeling complex physical dynamics is a fundamental task in science and engineering. Traditional physics-based models are sample efficient, and interpretable but often rely on rigid assumptions. Furthermore, direct numerical approximation is usually computationally intensive, requiring significant computational resources and expertise, and many real-world systems do not have fully-known governing laws. While deep learning (DL) provides novel alternatives for efficiently recognizing complex patterns and emulating nonlinear dynamics, its predictions do not necessarily obey the governing laws of physical systems, nor do they generalize well across different systems. Thus, the study of physics-guided DL emerged and has gained great progress. Physics-guided DL aims to take the best from both physics-based modeling and state-of-the-art DL models to better solve scientific problems. In this paper, we provide a structured overview of existing methodologies of integrating prior physical knowledge or physics-based modeling into DL, with a special emphasis on learning dynamical systems. We also discuss the fundamental challenges and emerging opportunities in the area.
Incorporating uncertainty quantification into travel mode choice modeling: a Bayesian neural network (BNN) approach and an uncertainty-guided active survey framework
Instruction-Guided Editing Controls for Images and Multimedia: A Survey in LLM era
Griffith University(格里菲斯大学);University of Bremen(不来梅大学);Ho Chi Minh City University of Technology(胡志明市技术大学);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);Hanoi University of Science and Technology(河内科技大学);The University of Queensland(昆士兰大学)
Physics guided neural networks for modelling of non-linear dynamics
Norwegian University of Science and Technology(挪威科技大学);Oklahoma State University(俄克拉荷马州立大学);SINTEF Digital(SINTEF数字研究所)
当前人工智能浪潮的成功可以部分归功于深度神经网络,事实证明,深度神经网络在以最少的人为干预从大型数据集中学习复杂模式方面非常有效。然而,它是很难的训练这些模型的复杂动力系统的数据单独由于其低的数据效率和敏感性的超参数和初始化。这项工作表明,在DNN的中间层注入部分已知的信息可以提高模型的准确性,降低模型的不确定性,并在训练过程中提高收敛性。这些物理引导的神经网络的价值已经通过学习由非线性系统理论中的五个著名方程表示的各种非线性动力系统的动力学来证明:Lotka-Volterra,Duffing,Van der Pol,Lorenz和Henon-Heiles系统。
Learning Guided Automated Reasoning: A Brief Survey
Czech Technical University in Prague(捷克技术大学布拉格);Radboud University Nijmegen(拉德堡德大学奈杰姆);Czech Academy of Sciences Institute for Computer Science(捷克科学院计算机科学研究所);University of Innsbruck(因斯布鲁克大学)
From Redundancy to Minimality: Fixed-Point-Guided Hierarchical Reduction of Learned Piecewise-Linear Dynamics
Osaka Metropolitan University(大阪公立大学);International Research Center for Neurointelligence (IRCN), The University of Tokyo(东京大学国际神经智能研究中心);Nagoya Institute of Technology(名古屋工业大学)
GAMR: A Guided Attention Model for (visual) Reasoning
Carney Institute for Brain Science(卡尼脑科学研究所);Brown University(布朗大学);Centre de Recherche Cerveau et Cognition(脑与认知研究中心);CNRS(法国国家科学研究中心);Université de Toulouse(图卢兹大学);Artificial and Natural Intelligence Toulouse Institute(图卢兹人工智能与自然智能研究所)
Entropy Guided Dynamic Patch Segmentation for Time Series Transformers
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore(南洋理工大学电子与电气工程学院);Institute for Infocomm Research, A*STAR, Singapore(信息通信研究所,A*STAR,新加坡);Department of Computer Science, Khalifa University, UAE(计算机科学系,哈利法大学,阿联酋);Information Systems Technology and Design, Singapore University of Technology and Design, Singapore(信息系统技术与设计,新加坡科技与设计大学,新加坡)