Computer-generated forecasts divide the earth's surface into gridboxes, each now ~25% of the size of London, and predict one value per gridbox. If weather varies markedly within a gridbox forecasts for specific sites inevitably fail. A completely new statistical post-processing method, using ensemble forecasts as input, anticipates two gridbox-weather-dependant factors: degree of variation in each gridbox, and bias on the gridbox scale. Globally, skill improves substantially; for extreme rainfall, for example, useful forecasts extend 5 days ahead. Without post-processing this limit is < 1 day. Relative to historical forecasting advances this constitutes ground-breaking progress. The key drivers, incorporated during calibration, are meteorological understanding and abandoning classical notions that only local data be used. Instead we simply recognise that "showers are showers, wherever they occur worldwide" which delivers a huge increase in calibration dataset size. Numerous multi-faceted applications include improved flash flood warnings, physics-related insights into model weaknesses and global pointwise re-analyses.
We investigate the relationships between weather forecasting, weather derivatives, the Black-Scholes equation, Feynmann-Kac theory and the Fokker-Planck equation. There is one useful result, but on the whole the relations we present seem to be more interesting than practically useful.
We show that probabilistic weather forecasts of site specific temperatures can be dramatically improved by using seasonally varying rather than constant calibration parameters.
Historical observations of severe weather and simulated severe weather environments (i.e., features) from the Global Ensemble Forecast System v12 (GEFSv12) Reforecast Dataset (GEFS/R) are used in conjunction to train and test random forest (RF) machine learning (ML) models to probabilistically forecast severe weather out to days 4--8. RFs are trained with 9 years of the GEFS/R and severe weather reports to establish statistical relationships. Feature engineering is briefly explored to examine alternative methods for gathering features around observed events, including simplifying features usin…
Rainfall is an important variable to be able to monitor and forecast across Africa, due to its impact on agriculture, food security, climate related diseases and public health. Numerical Weather Models (NWM) are an important component of this work, due to their complete spatial coverage, high resolution, and ability to forecast into the future. In this study, we seek to evaluate the spatiotemporal skill of short-term rainfall forecasts of rainfall across Africa. Specifically, the European Centre for Medium-Range Weather Forecasts (ECMWF) and the National Centers for Environmental Prediction-Gl…
Stockholm University（斯德哥尔摩大学）；Uppsala University（乌普萨拉大学）
Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast, by computing the ensemble's spread. However, generating an ensemble with a good spread-error relationship is far from trivial, and a wide range of approaches to achieve this have been explored -- chiefly in the context of numerical weather prediction models. Here, we aim to transform a deterministic neural network weather forecasting system into an ensemble forecasting system. We test four methods to generate the ensemble: random initial perturbations, retraining of the neural network, use of random dro…
The Met Office Space Weather Operations Centre was founded in 2014 and part of its remit is a daily Space Weather Technical Forecast to help the UK build resilience to space weather impacts; guidance includes four day geo-magnetic storm forecasts (GMSF) and X-ray flare forecasts (XRFF). It is crucial for forecasters, users, modelers and stakeholders to understand the strengths and weaknesses of these forecasts; therefore, it is important to verify against the most reliable truth data source available. The present study contains verification results for XRFFs using GOES-15 satellite data and GM…
University of Cambridge（剑桥大学）；Vector Institute（矢量研究所）；University of Toronto（多伦多大学）；Microsoft Research（微软研究院）；British Antarctic Survey（英国南极调查局）；The Alan Turing Institute（阿兰·图灵研究所）；European Centre for Medium-Range Weather Forecasts（欧洲中期天气预报中心）；Google Deepmind（谷歌DeepMind）
In this paper, we present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For this purpose, we establish a data-driven environment by downloading $43$ years of hourly global weather data from the 5th generation of ECMWF reanalysis (ERA5) data and train a few deep neural networks with about $256$ million parameters in total. The spatial resolution of forecast is $0.25^\circ\times0.25^\circ$, comparable to the ECMWF Integrated Forecast Systems (IFS). More importantly, for the first time, an AI-based method outperforms state-of-the-art numerical weather …
We present a data-driven approach for forecasting global weather using graph neural networks. The system learns to step forward the current 3D atmospheric state by six hours, and multiple steps are chained together to produce skillful forecasts going out several days into the future. The underlying model is trained on reanalysis data from ERA5 or forecast data from GFS. Test performance on metrics such as Z500 (geopotential height) and T850 (temperature) improves upon previous data-driven approaches and is comparable to operational, full-resolution, physical models from GFS and ECMWF, at least…
Results of direct numerical simulations have been used to show that intensive thermal convection in a horizontal layer and on a hemisphere can be described by the distributed chaos approach. The vorticity and helicity dominated distributed chaos were considered for this purpose. Results of numerical simulations of the Weather Research and Forecast Model (with the moist convection and with the Coriolis effect) and of the Coupled Ocean-Atmosphere Mesoscale Prediction System (COAMPS) were also analysed to demonstrate applicability of this approach to the atmospheric processes. The ensemble foreca…
Cooperative Institute for Mesoscale Meteorological Studies（中尺度气象研究合作所）；NOAA/OAR/National Severe Storms Laboratory（美国国家海洋和大气管理局/海洋与大气研究/国家强风暴实验室）；School of Meteorology, University of Oklahoma（俄克拉荷马大学气象学院）；School of Computer Science, University of Oklahoma（俄克拉荷马大学计算机科学学院）
A primary goal of the National Oceanic and Atmospheric Administration (NOAA) Warn-on-Forecast (WoF) project is to provide rapidly updating probabilistic guidance to human forecasters for short-term (e.g., 0-3 h) severe weather forecasts. Maximizing the usefulness of probabilistic severe weather guidance from an ensemble of convection-allowing model forecasts requires calibration. In this study, we compare the skill of a simple method using updraft helicity against a series of machine learning (ML) algorithms for calibrating WoFS severe weather guidance. ML models are often used to calibrate se…
Logistic models are studied as a tool to convert output from numerical weather forecasting systems (deterministic and ensemble) into probability forecasts for binary events. A logistic model obtains by putting the logarithmic odds ratio equal to a linear combination of the inputs. As any statistical model, logistic models will suffer from over-fitting if the number of inputs is comparable to the number of forecast instances. Computational approaches to avoid over-fitting by regularisation are discussed, and efficient approaches for model assessment and selection are presented. A logit version …
University of Hawaii Manoa（夏威夷大学马诺阿分校）；Nimbus AI LLC（Nimbus人工智能有限责任公司）
Forecasting future weather and climate is inherently difficult. Machine learning offers new approaches to increase the accuracy and computational efficiency of forecasts, but current methods are unable to accurately model uncertainty in high-dimensional predictions. Score-based diffusion models offer a new approach to modeling probability distributions over many dependent variables, and in this work, we demonstrate how they provide probabilistic forecasts of weather and climate variables at unprecedented resolution, speed, and accuracy. We apply the technique to day-ahead solar irradiance fore…
Extreme weather events have significant consequences, dominating the impact of climate on society. While high-resolution weather models can forecast many types of extreme events on synoptic timescales, long-term climatological risk assessment is an altogether different problem. A once-in-a-century event takes, on average, 100 years of simulation time to appear just once, far beyond the typical integration length of a weather forecast model. Therefore, this task is left to cheaper, but less accurate, low-resolution or statistical models. But there is untapped potential in weather model output: …
Intuitively, one would expect a more skillful forecast if predicting weather averaged over one week instead of the weather averaged over one day, and similarly for different spatial averaging areas. However, there are few systematic studies of averaging and forecast skill with modern forecasts, and it is therefore not clear how much improvement in forecast performance is produced via averaging. Here we present a direct investigation of averaging effects, based on data from operational numerical weather forecasts. Data is analyzed for precipitation and surface temperature, for lead times of rou…
Huracan: A skillful end-to-end data-driven system for ensemble data assimilation and weather prediction
Microsoft Corporation（微软公司）；Department of Earth System Science, Ministry of Education Key Laboratory for Earth System Modeling, Institute for Global Change Studies（教育部地球系统科学部门地球系统建模重点实验室，全球变化研究机构）；Tsinghua University（清华大学）
FuXi-2.0: Advancing machine learning weather forecasting model for practical applications
Artificial Intelligence Innovation and Incubation Institute, Fudan University（复旦大学人工智能创新与孵化研究院）；Shanghai Academy of Artificial Intelligence for Science（上海科学人工智能研究院）
Global Forecasting of Tropical Cyclone Intensity Using Neural Weather Models
Faculty of Geosciences and Environment, University of Lausanne（洛桑大学地球与环境科学学院）；Expertise Center for Climate Extremes, University of Lausanne（洛桑大学气候极端研究中心）；Environmental Remote Sensing Laboratory, EPFL（洛桑联邦理工学院环境遥感实验室）
Post-processing ensemble prediction systems can improve the reliability of weather forecasting, especially for extreme event prediction. In recent years, different machine learning models have been developed to improve the quality of weather post-processing. However, these models require a comprehensive dataset of weather simulations to produce high-accuracy results, which comes at a high computational cost to generate. This paper introduces the ENS-10 dataset, consisting of ten ensemble members spanning 20 years (1998-2017). The ensemble members are generated by perturbing numerical weather s…
NVIDIA Corporation（英伟达公司）；University of Michigan（密歇根大学）；Rice University（莱斯大学）；California Institute of Technology（加州理工学院）；Purdue University（普渡大学）
FourCastNet, short for Fourier Forecasting Neural Network, is a global data-driven weather forecasting model that provides accurate short to medium-range global predictions at $0.25^{\circ}$ resolution. FourCastNet accurately forecasts high-resolution, fast-timescale variables such as the surface wind speed, precipitation, and atmospheric water vapor. It has important implications for planning wind energy resources, predicting extreme weather events such as tropical cyclones, extra-tropical cyclones, and atmospheric rivers. FourCastNet matches the forecasting accuracy of the ECMWF Integrated F…
Numerical models outperform AI weather forecasts of record-breaking extremes
Research Institute for Statistics and Information Science, University of Geneva（统计与信息科学研究所，日内瓦大学）；Scientific Computing Center, Karlsruhe Institute of Technology（科学计算中心，卡尔斯鲁厄理工大学）；Institute for Atmospheric and Climate Science, Department of Environmental Systems Science, ETH Zurich（大气与气候科学研究所，环境系统科学系，苏黎世联邦理工学院）；Department of Compound Environmental Risks,Helmholtz Centre for Environmental Research – UFZ（复合环境风险部门，环境研究中心——UFZ）；Department of Hydro Sciences, TUD Dresden University of Technology（水科学系，德累斯顿理工大学）
