arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.15917cs.LG
收藏

用于降水临近预报的自监督时空学习器

Self-supervised Spatial-Temporal Learner for Precipitation Nowcasting

Utrecht University(乌得勒支大学)

Haotian Li, Arno Siebes, Siamak Mehrkanoon

AI总结:

针对降水临近预报依赖全监督的问题,提出自监督时空模型SpaT-SparK,结合掩码图像建模预训练与转换网络捕捉时空关系,在NL-50数据集上超越SmaAt-UNet等基线模型,实现更准确的预报。

摘要:

临近预报,即天气的短期预测,对于做出及时且依赖天气的决策至关重要。具体而言,降水临近预报旨在预测6小时时间范围内局部地区的降水。该任务可被构建为时空序列预测问题,其中深度学习方法尤为有效。然而,尽管自监督学习取得了进展,但大多数成功的临近预报方法仍采用全监督方式。自监督学习有利于预训练模型在无需大量标注数据的情况下学习表示。在本研究中,我们利用自监督学习的优势,并将其与时空学习相结合,开发了一种新颖的模型SpaT-SparK。SpaT-SparK包含一个基于CNN的编码器-解码器结构(通过掩码图像建模(MIM)任务进行预训练),以及一个在下游任务中捕捉过去与未来降水图之间时间关系的转换网络。我们在NL-50数据集上进行了实验以评估SpaT-SparK的性能。结果表明,SpaT-SparK优于现有的基线监督模型(如SmaAt-UNet),提供了更准确的临近预报预测。

英文摘要:

Nowcasting, the short-term prediction of weather, is essential for making timely and weather-dependent decisions. Specifically, precipitation nowcasting aims to predict precipitation at a local level within a 6-hour time frame. This task can be framed as a spatial-temporal sequence forecasting problem, where deep learning methods have been particularly effective. However, despite advancements in self-supervised learning, most successful methods for nowcasting remain fully supervised. Self-supervised learning is advantageous for pretraining models to learn representations without requiring extensive labeled data. In this work, we leverage the benefits of self-supervised learning and integrate it with spatial-temporal learning to develop a novel model, SpaT-SparK. SpaT-SparK comprises a CNN-based encoder-decoder structure pretrained with a masked image modeling (MIM) task and a translation network that captures temporal relationships among past and future precipitation maps in downstream tasks. We conducted experiments on the NL-50 dataset to evaluate the performance of SpaT-SparK. The results demonstrate that SpaT-SparK outperforms existing baseline supervised models, such as SmaAt-UNet, providing more accurate nowcasting predictions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑