Universal Differential Equations for Scientific Machine Learning
Massachusetts Institute of Technology(麻省理工学院);University of Maryland, Baltimore(马里兰大学巴尔的摩分校);Julia Computing(Julia计算公司);Otto von Guericke University, Magdeburg(马格德堡奥托·冯·格里克大学);Saint Petersburg State University(圣彼得堡国立大学)
Christopher Rackauckas, Yingbo Ma, Julius Martensen, Collin Warner, Kirill Zubov, Rohit Supekar, Dominic Skinner, Ali Ramadhan, Alan Edelman
In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets." In this manuscript we introduce the SciML software ecosystem as a tool for mixing the information of physical laws and scientific models with data-driven machine learning approaches. We describe a mathematical object, which we denote universal differential equations (UDEs), as the unifying framework connecting the ecosystem. We show how a wide variety of applications, from automatically discovering biological mechanisms to solving high-dimensional Hamilton-Jacobi-Bellman equations, can be phrased and efficiently handled through the UDE formalism and its tooling. We demonstrate the generality of the software tooling to handle stochasticity, delays, and implicit constraints. This funnels the wide variety of SciML applications into a core set of training mechanisms which are highly optimized, stabilized for stiff equations, and compatible with distributed parallelism and GPU accelerators.
EAPCR: A Universal Feature Extractor for Scientific Data without Explicit Feature Relation Patterns
Dali University(大理大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);Stony Brook University(石溪大学);Rutgers University(罗格斯大学);Chinese Academy of Sciences(中国科学院)
Scientific Machine Learning of Flow Resistance Using Universal Shallow Water Equations with Differentiable Programming
Department of Civil and Environmental Engineering, Pennsylvania State University, University Park, Pennsylvania, USA 16802(宾夕法尼亚州立大学土木与环境工程系,大学公园,宾夕法尼亚州,美国 16802);Institute of Computational and Data Sciences, Pennsylvania State University, University Park, Pennsylvania, USA 16802(宾夕法尼亚州立大学计算与数据科学研究所,大学公园,宾夕法尼亚州,美国 16802)
RAMS: Residual-based adversarial-gradient moving sample method for scientific machine learning in solving partial differential equations
Department of Civil and Environmental Engineering, Hong Kong Polytechnic University(香港理工大学土木与环境工程系);Department of Statistics and Data Science, Yale University(耶鲁大学统计与数据科学系)
A comparative study of NeuralODE and Universal ODE approaches to solving Chandrasekhar White Dwarf equation
National Autonomous University of Mexico(墨西哥国立自治大学);Vizuara AI Labs(Vizuara AI实验室);Massachusetts Institute of Technology(麻省理工学院);Purdue University(普渡大学)
Non-Negative Universal Differential Equations With Applications in Systems Biology
Rheinische Friedrich-Wilhelms-Universität Bonn(莱茵河畔腓特烈-威廉斯-波恩大学);Helmholtz Zentrum München Deutsches Forschungszentrum für Gesundheit und Umwelt (GmbH)(慕尼黑亥姆霍兹德国健康与环境研究中心(有限责任公司))
Universal Time Series Generation with Neural Controlled Differential Equations
Heidelberg Institute for Theoretical Studies(海德堡理论研究所);IAR, Karlsruhe Institute of Technology(卡尔斯鲁厄技术大学IAR部门);Max Planck Institute for Polymer Research(马克斯·普朗克聚合物研究所);IWR, Heidelberg University(海德堡大学IWR部门);Dept. of Computer Science, University of Toronto(多伦多大学计算机科学系);Mathematical Institute, University of Oxford(牛津大学数学研究所);Vector Institute, Toronto, Canada(多伦多向量研究所)