AirFormer:用Transformers预测中国全国空气质量
AirFormer: Predicting Nationwide Air Quality in China with Transformers
摘要:
空气污染是影响人类健康和生计的关键问题,也是经济和社会增长的障碍之一。空气质量预测已成为一项日益重要的工作,具有重大的社会影响,特别是在中国等新兴国家。在本文中,我们提出了一种新的Transformer架构,称为AirFormer,以前所未有的精细空间粒度覆盖数千个位置,共同预测中国全国范围内的空气质量。AirFormer将学习过程分为两个阶段:1)自下而上的确定性阶段,包含两种新型的自我注意机制,以有效地学习时空表示; 2)自上而下的随机阶段,包含潜在变量,以捕获空气质量数据的内在不确定性。我们使用中国大陆1,085个站点的4年数据对AirFormer进行了评估。与最先进的模型相比,AirFormer在72小时的未来预测中减少了5%~8%的预测误差。我们的源代码可以在https://github.com/yoshall/airformer上找到。
英文摘要:
Air pollution is a crucial issue affecting human health and livelihoods, as well as one of the barriers to economic and social growth. Forecasting air quality has become an increasingly important endeavor with significant social impacts, especially in emerging countries like China. In this paper, we present a novel Transformer architecture termed AirFormer to collectively predict nationwide air quality in China, with an unprecedented fine spatial granularity covering thousands of locations. AirFormer decouples the learning process into two stages -- 1) a bottom-up deterministic stage that contains two new types of self-attention mechanisms to efficiently learn spatio-temporal representations; 2) a top-down stochastic stage with latent variables to capture the intrinsic uncertainty of air quality data. We evaluate AirFormer with 4-year data from 1,085 stations in the Chinese Mainland. Compared to the state-of-the-art model, AirFormer reduces prediction errors by 5%~8% on 72-hour future predictions. Our source code is available at https://github.com/yoshall/airformer.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。