Vision-LLMs for Spatiotemporal Traffic Forecasting
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Southwest University(西南大学);Department of Computing and Communication Engineering, Beijing University of Science and Technology(北京科技大学计算机与通信工程学院);Department of Electrical and Computer Engineering, Northwestern University(西北大学电气与计算机工程系)
Ning Yang, Hengyu Zhong, Haijun Zhang, Randall Berry
Accurate spatiotemporal traffic forecasting is a critical prerequisite for proactive resource management in dense urban mobile networks. While large language models have shown promise in time series analysis, they inherently struggle to model the complex spatial dependencies of grid-based traffic data. Effectively extending large language models to this domain is challenging, as representing the vast amount of information from dense geographical grids can be inefficient and overwhelm the model's context. To address these challenges, we propose ST-Vision-LLM, a novel framework that reframes spatiotemporal forecasting as a vision-language fusion problem. Our approach leverages a Vision-LLM visual encoder to process historical global traffic matrices as image sequences, providing the model with a comprehensive global view to inform cell-level predictions. To overcome the inefficiency of large language models in handling numerical data, we introduce an efficient encoding scheme that represents floating-point values as single tokens via a specialized vocabulary, coupled with a two-stage numerical alignment fine-tuning process. The model is first trained with supervised fine-tuning and then further optimized for predictive accuracy using group relative policy optimization, a memory-efficient reinforcement learning method. Evaluations on real-world mobile traffic datasets demonstrate that ST-Vision-LLM outperforms existing methods by 15.6% in long-term prediction accuracy and exceeds the best baseline by around 30% on average in cross-domain few-shot scenarios. Our extensive experiments validate the model's strong generalization capabilities across various data-scarce environments.
Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Model
School of Engineering and Technology, China University of Geosciences (Beijing)(工程与技术学院,中国地质大学(北京));School of Geological Engineering and Geomatics, Chang'an University(地质工程与测绘学院,长安大学)
Heterogeneity-Informed Meta-Parameter Learning for Spatiotemporal Time Series Forecasting
Southern University of Science and Technology(南方科技大学);The University of Tokyo(东京大学);Hong Kong University of Science and Technology(香港科技大学);Squirrel AI(松鼠AI);Jilin University(吉林大学)
Spatiotemporal Attention Networks for Wind Power Forecasting
System Engineering Institute, Xi’an Jiaotong University(西安交通大学系统工程研究所);Rutgers University(罗格斯大学);Electric Power Research Institute, State Grid Liaoning Electric Power Co. Ltd.(国网辽宁省电力有限公司电力科学研究院)
Discovering the Precursors of Traffic Breakdowns Using Spatiotemporal Graph Attribution Networks
Department of Civil Engineering and Engineering Mechanics, Columbia University School of Economics, Minzu University of China(土木工程与工程力学系,哥伦比亚大学经济学院,中国民族大学);Vehicle and Mobility Systems Department, Argonne National Laboratory(车辆与移动系统部,阿贡国家实验室);School of Sustainable Engineering and the Built Environment, Arizona State University(可持续工程与环境学院,亚利桑那州立大学)
Leveraging Spatiotemporal Graph Neural Networks for Multi-Store Sales Forecasting
Department of Chemical Engineering, IIT Bombay(印度博亚理工大学化学工程系);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
MNT-TNN: Spatiotemporal Traffic Data Imputation via Compact Multimode Nonlinear Transform-based Tensor Nuclear Norm
Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences(智能机器研究所,合肥物理科学研究院,中国科学院);University of Science and Technology of China(中国科学技术大学)
Federated Dynamic Modeling and Learning for Spatiotemporal Data Forecasting
COSYS-GRETTIA, Gustave Eiffel University, 77420 France(COSYS-GRETTIA,巴黎-伊夫林大学);ENTPE, University of Lyon(ENTPE,里昂大学);the LICIT-ECO7 University Gustave Eiffel, France(LICIT-ECO7 巴黎-伊夫林大学)
Practical Adversarial Attacks on Spatiotemporal Traffic Forecasting Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Guangzhou HKUST Fok Ying Tung Research Institute(广州香港科技大学霍英东研究院);The Hong Kong University of Science and Technology(香港科技大学)
Weaver: Kronecker Product Approximations of Spatiotemporal Attention for Traffic Network Forecasting
Department of Civil, Environmental, and Geo- Engineering, University of Minnesota, Twin Cities, 500 Pillsbury Drive S.E., Minneapolis, MN 55455-0116, United States of America(土木、环境与地球工程系,明尼苏达大学,双城校区)
Spatiotemporal Forecasting of Traffic Flow using Wavelet-based Temporal Attention
Sorbonne University(索邦大学);Indian Institute of Science, Education and Research, Kolkata(印度科学教育与研究学院(加尔各答));International Institute of Information Technology, Bangalore(班加罗尔国际信息技术学院)
Spatiotemporal Graph Neural Networks in short term load forecasting: Does adding Graph Structure in Consumption Data Improve Predictions?
Interdisciplinary Centre for Security, Reliability and Trust - SnT, University of Luxembourg(卢森堡大学安全、可靠性与信任跨学科中心 - SnT);University of Luxembourg(卢森堡大学)
Hybrid Quantum-Classical Spatiotemporal Forecasting for 3D Cloud Fields
CMA Earth system Modeling and Prediction Center (CEMC)(中国气象局地球系统数值预报中心);State Key Laboratory of Severe Weather (LaSW)(灾害天气国家重点实验室);School of Computer Science and Engineering, Sichuan University of Science and Engineering(四川轻化工大学计算机科学与工程学院);School of Electronic and Communication Engineering, Guangzhou University(广州大学电子与通信工程学院);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院)