Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in advance. First studies show promise but the lack of a common dataset and evaluation metrics make inter-comparison between studies difficult. Here we present a benchmark dataset for data-driven medium-range weather forecasting, a topic of high scientific interest for atmospheric and computer scientists alike. We provide data derived from the ERA5 archive that has been processed to facilitate the use in machine learning models. We propose simple and clear evaluation metrics which will enable a direct comparison between different methods. Further, we provide baseline scores from simple linear regression techniques, deep learning models, as well as purely physical forecasting models. The dataset is publicly available at https://github.com/pangeo-data/WeatherBench and the companion code is reproducible with tutorials for getting started. We hope that this dataset will accelerate research in data-driven weather forecasting.
Probabilistic Forecasting for Dynamical Systems with Missing or Imperfect Data
Institute of Applied Mathematics(应用数学研究所);University of British Columbia(不列颠哥伦比亚大学);Recherche en prévision numérique atmosphérique(大气数值预报研究中心);Environnement et Changement climatique Canada(加拿大环境与气候变化部)
Benchmarking Physics-Informed Time-Series Models for Operational Global Station Weather Forecasting
Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong SAR China(香港科技大学计算机科学与工程系);Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China(南方科技大学计算机科学与工程系);School of Computer and Information Sciences, University of Newcastle, Newcastle, Australia(新castle大学计算机与信息科学学院);Hangzhou Innovation Institute of Beihang University, Hangzhou, China(北京航空航天大学杭州创新研究院);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室)
Weather2K: A Multivariate Spatio-Temporal Benchmark Dataset for Meteorological Forecasting Based on Real-Time Observation Data from Ground Weather Stations
Beijing University of Posts and Telecommunications(北京邮电大学);National Meteorological Center, China Meteorological Administration(中国气象局国家气象中心)
EWMoE: An effective model for global weather forecasting with mixture-of-experts
University of Electronic Science and Technology of China(电子科技大学);Sichuan Artificial Intelligence Research Institute(四川人工智能研究院);Institute of Plateau Meteorology, China Meteorological Administration(中国气象局高原气象研究所)
University of Cambridge(剑桥大学);Vector Institute(矢量研究所);University of Toronto(多伦多大学);Microsoft Research(微软研究院);British Antarctic Survey(英国南极调查局);The Alan Turing Institute(阿兰·图灵研究所);European Centre for Medium-Range Weather Forecasts(欧洲中期天气预报中心);Google Deepmind(谷歌DeepMind)
FengWu-GHR: Learning the Kilometer-scale Medium-range Global Weather Forecasting
Shanghai AI Laboratory(上海人工智能实验室);Hong Kong University of Science and Technology(香港科技大学);Nanjing University of Information Science and Technology(南京信息工程大学);National Meteorological Information Center of CMA(中国气象局国家气象信息中心);National Meteorological Center of CMA(中国气象局国家气象中心)
PEAR: Equal Area Weather Forecasting on the Sphere
VERSES AI;Department of Mathematical Sciences(数学科学系);Chalmers University of Technology(楚姆勒斯技术大学);University of Gothenburg(哥德堡大学);Department of Computer Science and Engineering(计算机科学与工程系);Department of Physics and Astronomy(物理与天文学系);Recohere
W-MAE: Pre-trained weather model with masked autoencoder for multi-variable weather forecasting
University of Electronic Science and Technology of China(电子科技大学);Institute of Plateau Meteorology, China Meteorological Administration(中国气象局高原气象研究所);Institute of Urban Meteorology, China Meteorological Administration(中国气象局城市气象研究所)
Butterfly Effect Confirmed in Global AI Weather Models: Evidence from Tropical Cyclone Forecasting
College of Meteorology and Oceanography, National University of Defense Technology(国防科技大学气象海洋学院);Laboratory of Atmospheric Environmental Monitoring and Early Warning for Low-Altitude Economy, National University of Defense Technology(国防科技大学低空经济大气环境监测与预警实验室);Hunan Institute of Advanced Technology(湖南先进技术研究院);College of Atmospheric Sciences, Lanzhou University(兰州大学大气科学学院);Institute of Atmospheric Physics, Chinese Academy of Sciences(中国科学院大气物理研究所);National Meteorological Centre, China Meteorological Administration(中国气象局国家气象中心);Department of Atmospheric and Oceanic Sciences and Institute of Atmospheric Sciences, Fudan University(复旦大学大气与海洋科学系及大气科学研究所);Key Laboratory of High Impact Weather (special), China Meteorological Administration(中国气象局极端天气重点实验室)
Xaurora: Generative Weather Forecasting with Denoising Stochastic Interpolants from a Foundation Model Prior
Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Amsterdam(阿姆斯特丹大学);Delft University of Technology(代尔夫特理工大学);Centrum Wiskunde & Informatica(数学与计算机科学中心)