arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.17898cs.LGcs.AIcs.CY
收藏

FlashST:一种简单通用的交通预测提示调优框架

FlashST: A Simple and Universal Prompt-Tuning Framework for Traffic Prediction

South China University of Technology(华南理工大学);University of Hong Kong(香港大学);PAZHOU LAB(琶洲实验室)

Zhonghang Li, Lianghao Xia, Yong Xu, Chao Huang

AI总结:

FlashST提出简单通用的时空提示调优框架,通过轻量级提示网络和分布映射机制,提升交通预测模型在分布偏移下的泛化能力。

摘要:

交通预测的目标是准确预测和分析交通模式的动态变化,同时考虑空间和时间因素。然而,分布偏移的存在给该领域带来了重大挑战,因为现有模型在面对与训练分布显著不同的测试数据时,难以很好地泛化。为了解决这一问题,本文引入了一个简单通用的时空提示调优框架——FlashST,该框架将预训练模型适应于不同下游数据集的特定特征,提高了在多样化交通预测场景中的泛化能力。具体而言,FlashST框架采用轻量级时空提示网络进行上下文学习,捕获时空不变知识,并促进对多样化场景的有效适应。此外,我们结合了一种分布映射机制,以对齐预训练数据和下游数据的数据分布,促进时空预测中有效的知识迁移。实证评估表明,FlashST在使用多样化城市数据集的不同时空预测任务中表现出有效性。代码可在 https://github.com/HKUDS/FlashST 获取。

英文摘要:

The objective of traffic prediction is to accurately forecast and analyze the dynamics of transportation patterns, considering both space and time. However, the presence of distribution shift poses a significant challenge in this field, as existing models struggle to generalize well when faced with test data that significantly differs from the training distribution. To tackle this issue, this paper introduces a simple and universal spatio-temporal prompt-tuning framework-FlashST, which adapts pre-trained models to the specific characteristics of diverse downstream datasets, improving generalization in diverse traffic prediction scenarios. Specifically, the FlashST framework employs a lightweight spatio-temporal prompt network for in-context learning, capturing spatio-temporal invariant knowledge and facilitating effective adaptation to diverse scenarios. Additionally, we incorporate a distribution mapping mechanism to align the data distributions of pre-training and downstream data, facilitating effective knowledge transfer in spatio-temporal forecasting. Empirical evaluations demonstrate the effectiveness of our FlashST across different spatio-temporal prediction tasks using diverse urban datasets. Code is available at https://github.com/HKUDS/FlashST.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑