arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09371physics.ao-phcs.LG
收藏

WeatherReal:一个基于原位观测的天气模型评估基准

WeatherReal: A Benchmark Based on In-Situ Observations for Evaluating Weather Models

Microsoft Corporation(微软公司)

Weixin Jin, Jonathan Weyn, Pengcheng Zhao, Siqi Xiang, Jiang Bian, Zuliang Fang, Haiyu Dong, Hongyu Sun, Kit Thambiratnam, Qi Zhang

AI总结:

针对AI天气预报模型多基于再分析数据集训练评估、与实际观测有偏差的问题,研究提出基于全球近地表原位观测的基准数据集WeatherReal及配套评估框架,验证了原位观测的优势并完成多模型对比,推动预报研究向应用导向发展。

摘要:

近年来,基于人工智能的天气预报模型性能已追平甚至超越数值天气预报系统。但这类模型大多在ERA5等再分析数据集上完成训练与评估,而这类数据集作为数值模式的产物,在近地表温度、风、降水、云等公众高度关注的关键变量上,常与实际观测存在显著偏差。为解决这一偏差问题,我们提出了新型天气预报基准数据集WeatherReal,该数据集源自全球近地表原位观测,还配套了公开可用的质量控制与评估框架。本文详述了数据集的来源与处理方法,并通过对比分析与案例研究,进一步阐明了原位观测在捕捉超局地天气与极端天气方面的优势。我们借助WeatherReal评估了多个数据驱动模型,并将其与主流数值模型进行对比。本研究旨在推动基于人工智能的天气预报研究向更聚焦应用、更具业务可用性的方向发展。

英文摘要:

In recent years, AI-based weather forecasting models have matched or even outperformed numerical weather prediction systems. However, most of these models have been trained and evaluated on reanalysis datasets like ERA5. These datasets, being products of numerical models, often diverge substantially from actual observations in some crucial variables like near-surface temperature, wind, precipitation and clouds - parameters that hold significant public interest. To address this divergence, we introduce WeatherReal, a novel benchmark dataset for weather forecasting, derived from global near-surface in-situ observations. WeatherReal also features a publicly accessible quality control and evaluation framework. This paper details the sources and processing methodologies underlying the dataset, and further illustrates the advantage of in-situ observations in capturing hyper-local and extreme weather through comparative analyses and case studies. Using WeatherReal, we evaluated several data-driven models and compared them with leading numerical models. Our work aims to advance the AI-based weather forecasting research towards a more application-focused and operation-ready approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑