arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.14726cs.LG
收藏

将长期数据纳入短期交通预测模型训练

Incorporating Long-term Data in Training Short-term Traffic Prediction Model

Tongji University(同济大学);Key Laboratory of Road and Traffic Engineering, Ministry of Education(道路与交通工程教育部重点实验室);Urban Mobility Institute(城市移动性研究院)

Xiannan Huang, Shuhan Qiu, Yan Cheng, Quan Yuan, Chao Yang

AI总结:

本文研究长期历史数据对短期交通预测模型训练的影响,提出结合协变量分布加权对齐与环境感知学习的方法,以缓解协变量偏移和概念偏移,从而在大规模历史数据训练下显著降低测试误差并提升精度。

摘要:

短期交通量预测对智能交通系统至关重要,该领域已有大量研究。然而,现有研究大多集中于改进模型架构,忽视了训练数据量的影响。因此,在深入探讨扩充数据集(尤其是大规模历史数据)对训练的作用方面,仍存在明显空白。本研究使用纽约市包含出租车和自行车使用情况、跨度超过八年的两个数据集来检验这种影响。实验评估了分别使用最近12、24、48和96个月数据训练的模型精度。结果发现,包含96个月的训练集有时反而导致精度下降,这可能是由于历史交通模式与当前模式之间存在差异。随后进行分析,以识别模式不一致的潜在来源,其中可能包括协变量偏移和概念偏移。为解决这些偏移,我们提出了一种创新方法:通过加权方案对齐协变量分布以处理协变量偏移,并结合环境感知学习方法应对概念偏移。基于真实世界数据集的实验证明了我们方法的有效性,能够显著降低测试误差,并确保在使用大规模历史数据训练时提升精度。据我们所知,本研究是首次尝试评估连续扩充训练数据集对交通预测模型精度的影响。此外,我们的训练方法能够融入大多数现有短期交通预测模型,使其更适用于长期历史训练数据集。

英文摘要:

Short-term traffic volume prediction is crucial for intelligent transportation system and there are many researches focusing on this field. However, most of these existing researches concentrated on refining model architecture and ignored amount of training data. Therefore, there remains a noticeable gap in thoroughly exploring the effect of augmented dataset, especially extensive historical data in training. In this research, two datasets containing taxi and bike usage spanning over eight years in New York were used to test such effects. Experiments were conducted to assess the precision of models trained with data in the most recent 12, 24, 48, and 96 months. It was found that the training set encompassing 96 months, at times, resulted in diminished accuracy, which might be owing to disparities between historical traffic patterns and present ones. An analysis was subsequently undertaken to discern potential sources of inconsistent patterns, which may include both covariate shift and concept shift. To address these shifts, we proposed an innovative approach that aligns covariate distributions using a weighting scheme to manage covariate shift, coupled with an environment aware learning method to tackle the concept shift. Experiments based on real word datasets demonstrate the effectiveness of our method which can significantly decrease testing errors and ensure an improvement in accuracy when training with large-scale historical data. As far as we know, this work is the first attempt to assess the impact of contiguously expanding training dataset on the accuracy of traffic prediction models. Besides, our training method is able to be incorporated into most existing short-term traffic prediction models and make them more suitable for long term historical training dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑