Chaotic systems, such as turbulent flows, are ubiquitous in science and engineering. However, their study remains a challenge due to the large range scales, and the strong interaction with other, often not fully understood, physics. As a consequence, the spatiotemporal resolution required for accurate simulation of these systems is typically computationally infeasible, particularly for applications of long-term risk assessment, such as the quantification of extreme weather risk due to climate change. While data-driven modeling offers some promise of alleviating these obstacles, the scarcity of high-quality simulations results in limited available data to train such models, which is often compounded by the lack of stability for long-horizon simulations. As such, the computational, algorithmic, and data restrictions generally imply that the probability of rare extreme events is not accurately captured. In this work we present a general strategy for training neural network models to non-intrusively correct under-resolved long-time simulations of chaotic systems. The approach is based on training a post-processing correction operator on under-resolved simulations nudged towards a high-fidelity reference. This enables us to learn the dynamics of the underlying system directly, which allows us to use very little training data, even when the statistics thereof are far from converged. Additionally, through the use of probabilistic network architectures we are able to leverage the uncertainty due to the limited training data to further improve extrapolation capabilities. We apply our framework to severely under-resolved simulations of quasi-geostrophic flow and demonstrate its ability to accurately predict the anisotropic statistics over time horizons more than 30 times longer than the data seen in training.
Probabilistic error estimation for non-intrusive reduced models learned from data of systems governed by linear parabolic partial differential equations
Courant Institute of Mathematical Sciences, New York University(纽约大学柯朗数学科学研究所)
ClimateBench v2.0: Probabilistic Climate Model Benchmarking
Scripps Institution of Oceanography, University of California San Diego(加州大学圣地亚哥分校斯克里普斯海洋研究所);Deutsches Zentrum für Luft- und Raumfahrt e.V. (DLR)(德国航空航天中心);Schmidt Sciences(施密特科学中心);Jet Propulsion Laboratory, California Institute of Technology(加州理工学院喷气推进实验室);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室);University of Colorado Boulder(科罗拉多大学博尔德分校);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);University of East Anglia(东英吉利大学);Columbia University(哥伦比亚大学);Met Office(英国气象局);Google Research(谷歌研究院);Alfred Wegener Institute(阿尔弗雷德·魏格纳研究所);National Center for Atmospheric Research(美国国家大气研究中心);Otto von Guericke University Magdeburg(马格德堡奥托·冯·格里克大学);University of Bristol(布里斯托尔大学);University of California, Los Angeles(加州大学洛杉矶分校);NVIDIA Research(英伟达研究院);NASA Goddard Institute for Space Studies(美国国家航空航天局戈达德空间研究所);California Institute of Technology(加州理工学院)
Diffusion Model-based Probabilistic Downscaling for 180-year East Asian Climate Reconstruction
Nanjing University of Information Science and Technology(南京信息工程大学);Japan Agency for Marine-Earth Science and Technology(日本海洋研究开发机构);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Institute of Atmospheric Physics, Chinese Academy of Sciences(中国科学院大气物理研究所);Tokyo Institute of Technology(东京工业大学);RIKEN Center for Advanced Intelligence Project(理化学研究所革新智能综合研究中心)
Forecasting precipitation in the Arctic using probabilistic machine learning informed by causal climate drivers
Department of Science and Engineering, Sorbonne University, Abu Dhabi, United Arab Emirates(Sorbonne大学科学与工程系);Physics and Applied Mathematics Unit, Indian Statistical Institute, Kolkata 700108, India(印度统计研究院应用数学与物理单元);Sorbonne Center for Artificial Intelligence, Sorbonne University, Paris, 75005, France(Sorbonne大学人工智能中心);Indian Institute of Technology Gandhinagar, Gandhinagar 382355, India(印度理工学院冈丁加尔分校);National Centre for Polar and Ocean Research, Ministry of Earth Sciences, Vasco da Gama, 403804, India(国家极地与海洋研究中心);Center for Computational Natural Science and Bioinformatics, International Institute of Information Technology, Gachibowli, Hyderabad-500032, India(国际信息技术研究所计算自然科学与生物信息中心);Department of Dynamics, Lodz University of Technology, Stefanowskiego 1/15, 90–537 Lodz, Poland(Lodz技术大学动力学系);Centre for Mathematical Biology and Ecology, Department of Mathematics, Jadavpur University, Kolkata 700032, India(贾瓦德普大学数学生物学与生态中心)
Generative assimilation and prediction for weather and climate
Chinese Academy of Sciences(中国科学院);Nanjing University(南京大学);Technical University of Munich(慕尼黑工业大学);Potsdam Institute for Climate Impact Research(波茨坦气候影响研究所);Chinese Academy of Meteorological Sciences(中国气象科学研究院);National University of Defense Technology(国防科技大学);Peking University(北京大学);National Climate Center(国家气候中心);Xiong’an Institute of Meteorological Artificial Intelligence(雄安气象人工智能研究院)
Long-Term Probabilistic Forecast of Vegetation Conditions Using Climate Attributes in the Four Corners Region
Department of Statistics and Applied Probability, University of California Santa Barbara, CA, USA(统计学与应用概率系,加州大学圣芭芭拉分校);Department of Geography, University of California Santa Barbara, CA, USA(地理系,加州大学圣芭芭拉分校);Climate Hazards Center, University of California Santa Barbara, CA, USA(气候灾害中心,加州大学圣芭芭拉分校)
Latent Diffusion Model for Generating Ensembles of Climate Simulations
German Climate Computing Center (DKRZ)(德国气候计算中心(DKRZ));CEREA Écoles des Ponts(巴黎桥路学院CEREA实验室);EDF R&D(法国电力公司研发部);Max-Planck Institute of Meteorology(马克斯·普朗克气象研究所)
Generating High-Resolution Regional Precipitation Using Conditional Diffusion Model
School of Computing, KAIST(韩国科学技术院计算机学院);Data Science Group, IBS(基础科学研究院数据科学组);Department of Climate System, PNU(釜山大学气候系统系);Center for Climate Physics, IBS(基础科学研究院气候物理中心)
Machine Learning Workflows in Climate Modeling: Design Patterns and Insights from Case Studies
Department of Statistics, Columbia University(统计学系,哥伦比亚大学);NSF STC Learning the Earth with AI and Physics (LEAP)(NSF STC 学习地球与人工智能和物理(LEAP));Data Science Institute, Columbia University(数据科学研究所,哥伦比亚大学);Jet Propulsion Laboratory, California Institute of Technology(喷气推进实验室,加州理工学院);Department of Applied Physics and Applied Mathematics, Columbia University(应用物理与应用数学系,哥伦比亚大学)
High-Resolution Climate Projections Using Diffusion-Based Downscaling of a Lightweight Climate Emulator
Information Sciences and Technology, The Pennsylvania State University(宾夕法尼亚州立大学信息科学与技术系);Department of Applied Mathematics, University of California, Santa Cruz(加州大学圣克鲁兹分校应用数学系);Allen Institute for Artificial Intelligence (AI2)(人工智能研究所);School of Mechanical Engineering, Purdue University(普渡大学机械工程学院)
Uncertainty-aware neural emulation reveals climate-resilient maize traits at scale
Department of Mathematics and Department of Computer Science, Iowa State University(数学系和计算机科学系,爱荷华州立大学);Department of Horticultural Sciences, University of Florida(园艺科学系,佛罗里达大学);Department of Mechanical Engineering, and Translational AI Center, Iowa State University(机械工程系和转化人工智能中心,爱荷华州立大学)
Fast, Scale-Adaptive, and Uncertainty-Aware Downscaling of Earth System Model Fields with Generative Machine Learning
Technical University Munich(慕尼黑工业大学);Potsdam Institute for Climate Impact Research(波茨坦气候影响研究所);Institute of Atmospheric Physics, Chinese Academy of Sciences(中国科学院大气物理研究所);University of Exeter(埃克塞特大学)
A Data-Driven Probabilistic Framework for Cascading Urban Risk Analysis Using Bayesian Networks
Department of Computer Science and Engineering, School of Computing, Coimbatore, Amrita Vishwa Vidyapeetham, Tamil Nadu, India(计算机科学与工程系,计算学院,科瓦尔,阿米塔大学文理学院,泰米尔纳德邦,印度)