Accurately forecasting dynamic processes on graphs, such as traffic flow or disease spread, remains a challenge. While Graph Neural Networks (GNNs) excel at modeling and forecasting spatio-temporal data, they often lack the ability to directly incorporate underlying physical laws. This work presents TG-PhyNN, a novel Temporal Graph Physics-Informed Neural Network framework. TG-PhyNN leverages the power of GNNs for graph-based modeling while simultaneously incorporating physical constraints as a guiding principle during training. This is achieved through a two-step prediction strategy that enables the calculation of physical equation derivatives within the GNN architecture. Our findings demonstrate that TG-PhyNN significantly outperforms traditional forecasting models (e.g., GRU, LSTM, GAT) on real-world spatio-temporal datasets like PedalMe (traffic flow), COVID-19 spread, and Chickenpox outbreaks. These datasets are all governed by well-defined physical principles, which TG-PhyNN effectively exploits to offer more reliable and accurate forecasts in various domains where physical processes govern the dynamics of data. This paves the way for improved forecasting in areas like traffic flow prediction, disease outbreak prediction, and potentially other fields where physics plays a crucial role.
Leveraging Spatiotemporal Graph Neural Networks for Multi-Store Sales Forecasting
Department of Chemical Engineering, IIT Bombay(印度博亚理工大学化学工程系);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
Spatiotemporal Forecasting of Traffic Flow using Wavelet-based Temporal Attention
Sorbonne University(索邦大学);Indian Institute of Science, Education and Research, Kolkata(印度科学教育与研究学院(加尔各答));International Institute of Information Technology, Bangalore(班加罗尔国际信息技术学院)
Spatiotemporal Graph Neural Networks in short term load forecasting: Does adding Graph Structure in Consumption Data Improve Predictions?
Interdisciplinary Centre for Security, Reliability and Trust - SnT, University of Luxembourg(卢森堡大学安全、可靠性与信任跨学科中心 - SnT);University of Luxembourg(卢森堡大学)
Graph-based Forecasting with Missing Data through Spatiotemporal Downsampling
IDSIA USI-SUPSI(IDSIA USI-SUPSI(瑞士意大利语大学与瑞士应用科学大学联合机构));Università della Svizzera italiana(瑞士意大利语大学);Politecnico di Milano(米兰理工大学);UiT the Arctic University of Norway(挪威北极大学);NORCE, Norwegian Research Centre AS(NORCE挪威研究中心)
Chickenpox Cases in Hungary: a Benchmark Dataset for Spatiotemporal Signal Processing with Graph Neural Networks
The University of Edinburgh(爱丁堡大学);University of Cambridge(剑桥大学);Central European University(中欧大学);Obuda University(欧布达大学);Corvinus University of Budapest(布达佩斯考文纽斯大学)
STGformer: Efficient Spatiotemporal Graph Transformer for Traffic Forecasting
SUSTech-UTokyo Joint Research Center on Super Smart City(南方科技大学-东京大学超级智慧城市联合研究中心);Research Institute of Trustworthy Autonomous Systems(可信自主系统研究院);Southern University of Science and Technology (SUSTech)(南方科技大学);School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);University of Tokyo(东京大学)
Simple and Robust Forecasting of Spatiotemporally Correlated Small Earth Data with A Tabular Foundation Model
School of Engineering and Technology, China University of Geosciences (Beijing)(工程与技术学院,中国地质大学(北京));School of Geological Engineering and Geomatics, Chang'an University(地质工程与测绘学院,长安大学)
交通时间序列预测是具有挑战性的,因为来自不同位置的复杂时空动态时间序列通常具有不同的模式;并且对于相同的时间序列,模式可能随时间而变化,例如,在一天中存在显示出更强的时间相关性的某些时段。尽管最近的预测模型,特别是基于深度学习的模型,显示出有希望的结果,但它们受到时空不可知论的影响。这样的时空不可知模型采用共享参数空间,而不管时间序列位置和时间段,并且它们假设时间模式在位置之间是相似的,并且不会在时间上演变,这可能并不总是成立,从而导致次优结果。在这项工作中,我们提出了一个框架,旨在把时空不可知模型时空感知模型。为此,我们将来自不同位置的时间序列编码为随机变量,从中生成特定于位置和随时间变化的模型参数,以更好地捕捉时空动态。我们展示了如何整合的框架与规范的注意,使时空意识的注意。其次,为了补偿时空感知模型参数生成过程中引入的额外开销,提出了一种新的窗口注意机制,将复杂度从二次降低到线性,使得时空感知注意也具有竞争效率.我们在四个交通时间序列数据集上展示了强有力的经验证据,其中所提出的时空感知注意力在准确性和效率方面优于最先进的方法。这是“Towards Spatio-Temporal Aware Traffic Time Series Forecasting”的扩展版本,将出现在ICDE 2022 [1]中,包括其他实验结果。
Spatiotemporal Attention Networks for Wind Power Forecasting
System Engineering Institute, Xi’an Jiaotong University(西安交通大学系统工程研究所);Rutgers University(罗格斯大学);Electric Power Research Institute, State Grid Liaoning Electric Power Co. Ltd.(国网辽宁省电力有限公司电力科学研究院)
ASTGI: Adaptive Spatio-Temporal Graph Interactions for Irregular Multivariate Time Series Forecasting
School of Data Science and Engineering, East China Normal University, Shanghai, China(东华大学数据科学与工程学院,上海,中国);Engineering Research Center of Blockchain Data Management, Ministry of Education, China(教育部区块链数据管理工程研究中心,中国)
DiffSTG: Probabilistic Spatio-Temporal Graph Forecasting with Denoising Diffusion Models
School of Computer and Information Technology, Beijing Jiaotong University(北京交通大学计算机与信息技术学院);National University of Singapore(新加坡国立大学);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
ST-PCNN: Spatio-Temporal Physics-Coupled Neural Networks for Dynamics Forecasting
Florida Atlantic University(佛罗里达大西洋大学);Harbor Branch Oceanographic Institute, Florida Atlantic University(佛罗里达大西洋大学港口分支海洋研究所);Georgia Institute of Technology(佐治亚理工学院);Washington University School of Medicine(华盛顿大学医学院)
More Sensors Only One Field: Rethinking Continual Spatio-Temporal Forecasting
City University of Hong Kong (Dongguan)(香港城市大学(东莞));City University of Hong Kong(香港城市大学);Zhuhai College of Science and Technology(珠海科技学院);Northwestern Polytechnical University(西北工业大学)
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University(清华大学交叉信息研究院)
交通预测对于公共安全和资源优化至关重要,但由于三个方面而非常具有挑战性:i)当前现有的工作大多利用复杂的时间模式(例如,短期雷暴和长期每日趋势),这不能准确地捕获不同模式下的时空依赖性; i i)图位置编码的探索不足限制了常用的全图注意力网络中的空间信息的提取; iii)全图注意力的二次复杂性引入了大量的计算需求。为了实现有效的交通流预测,我们提出了一个有效的谱图注意力网络与解开交通序列。具体而言,利用离散小波变换来获得流量序列的低频和高频分量,并且精心设计了双通道编码器,以准确地捕获低频和高频分量的长期和短期模式下的时空依赖性。此外,一种新的基于小波的图位置编码和查询采样策略引入到我们的频谱图的注意力,有效地引导消息传递和有效地计算的注意力。在四个真实世界数据集上的大量实验表明了我们模型的优越性,即,以较低的计算代价获得较高的预测精度。
DRAN: A Distribution and Relation Adaptive Network for Spatio-temporal Forecasting
Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai(能源化学过程智能制造关键实验室,教育部,东华大学,上海);Faculty of Informatics, Università della Svizzera italiana(瑞士意大利大学信息学院);Department of Electronics, Information and Bioengineering, Politecnico di Milano(米兰理工学院电子、信息与生物工程系)