arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.02908eess.SPcs.LG
收藏

基于时空Transformer网络的交通流预测

Spatial-Temporal Transformer Networks for Traffic Flow Forecasting

Mingxing Xu, Wenrui Dai, Chunmiao Liu, Xing Gao, Weiyao Lin, Guo-Jun Qi, Hongkai Xiong

摘要:

交通预测已经成为智能交通系统的核心组成部分。然而,及时准确的交通预测,特别是长期预测,仍然是一个开放的挑战,由于高度非线性和动态的时空依赖性的交通流。在本文中,我们提出了一种新的范式时空Transformer网络(STTN),利用动态定向的空间依赖性和长期的时间依赖性,以提高长期流量预测的准确性。具体来说,我们提出了一个新的变种的图神经网络,命名为空间Transformer,通过动态建模有向空间依赖与自注意机制,以捕捉实时交通状况以及交通流的方向性。此外,不同的空间依赖模式可以联合建模与多头注意力机制,考虑不同的关系相关的不同因素(如相似性,连接性和协方差)。另一方面,时间Transformer被用来模拟跨多个时间步长的长范围双向时间依赖性。最后,它们被组成一个块,以联合建模的时空依赖性,准确的交通预测。与现有的作品相比,该模型能够在长范围的时空依赖性上进行快速和可扩展的训练。实验结果表明,该模型在实际PeMS-Bay和PeMSD 7(M)数据集上的长期流量预测结果优于现有模型.

英文摘要:

Traffic forecasting has emerged as a core component of intelligent transportation systems. However, timely accurate traffic forecasting, especially long-term forecasting, still remains an open challenge due to the highly nonlinear and dynamic spatial-temporal dependencies of traffic flows. In this paper, we propose a novel paradigm of Spatial-Temporal Transformer Networks (STTNs) that leverages dynamical directed spatial dependencies and long-range temporal dependencies to improve the accuracy of long-term traffic forecasting. Specifically, we present a new variant of graph neural networks, named spatial transformer, by dynamically modeling directed spatial dependencies with self-attention mechanism to capture realtime traffic conditions as well as the directionality of traffic flows. Furthermore, different spatial dependency patterns can be jointly modeled with multi-heads attention mechanism to consider diverse relationships related to different factors (e.g. similarity, connectivity and covariance). On the other hand, the temporal transformer is utilized to model long-range bidirectional temporal dependencies across multiple time steps. Finally, they are composed as a block to jointly model the spatial-temporal dependencies for accurate traffic prediction. Compared to existing works, the proposed model enables fast and scalable training over a long range spatial-temporal dependencies. Experiment results demonstrate that the proposed model achieves competitive results compared with the state-of-the-arts, especially forecasting long-term traffic flows on real-world PeMS-Bay and PeMSD7(M) datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑