arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2410.14099cs.LGcs.AI

ST-MoE-BERT:一种用于长期跨城市移动性预测的时空专家混合框架

ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mobility Prediction

Northeastern University(东北大学);Northwestern University(西北大学)

Haoyu He, Haozheng Luo, Qi R. Wang

AI总结:

本文提出ST-MoE-BERT框架,将跨城市移动性预测建模为时空分类问题,结合专家混合架构、BERT和迁移学习,在GEO-BLEU和DTW上平均提升8.29%。

摘要:

由于不同城市环境中固有的复杂多样的时空动态,跨多个城市预测人类移动性面临重大挑战。在本研究中,我们提出了一种稳健的方法来预测人类移动模式,称为ST-MoE-BERT。与现有方法相比,我们的方法将预测任务构建为一个时空分类问题。我们的方法将专家混合(Mixture-of-Experts)架构与BERT模型相结合,以捕捉复杂的移动动态并执行下游的人类移动性预测任务。此外,还整合了迁移学习以解决跨城市预测中数据稀缺的挑战。我们在GEO-BLEU和DTW上展示了所提模型的有效性,并将其与几种最先进的方法进行了比较。值得注意的是,ST-MoE-BERT实现了8.29%的平均改进。

英文摘要:

Predicting human mobility across multiple cities presents significant challenges due to the complex and diverse spatial-temporal dynamics inherent in different urban environments. In this study, we propose a robust approach to predict human mobility patterns called ST-MoE-BERT. Compared to existing methods, our approach frames the prediction task as a spatial-temporal classification problem. Our methodology integrates the Mixture-of-Experts architecture with BERT model to capture complex mobility dynamics and perform the downstream human mobility prediction task. Additionally, transfer learning is integrated to solve the challenge of data scarcity in cross-city prediction. We demonstrate the effectiveness of the proposed model on GEO-BLEU and DTW, comparing it to several state-of-the-art methods. Notably, ST-MoE-BERT achieves an average improvement of 8.29%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑