LIMP:大语言模型增强的意图感知移动性预测
LIMP: Large Language Model Enhanced Intent-aware Mobility Prediction
AI总结:
针对人类移动性预测中隐含意图建模的挑战,提出LIMP框架,通过A2I智能体工作流与高效微调将LLM常识推理能力迁移至小模型,并结合Transformer实现意图感知预测,在真实数据集上显著提升了下一位置预测准确性与可解释性。
摘要:
人类移动性预测对于城市规划和交通管理等应用至关重要,但由于人类行为背后复杂且往往隐含的意图,这仍然具有挑战性。现有模型主要关注时空模式,较少关注支配移动的潜在意图。大语言模型(LLMs)的最新进展为将常识推理整合到移动性预测中提供了一个有前景的替代研究角度。然而,这是一个非平凡的问题,因为LLMs原生并非为移动意图推理而构建,并且它们还面临可扩展性问题以及与时空模型整合的困难。为了应对这些挑战,我们提出了一种新颖的LIMP(LLMs for Intent-ware Mobility Prediction)框架。具体来说,LIMP引入了“分析-抽象-推理”(A2I)智能体工作流,以释放LLM的常识推理能力用于移动意图推理。此外,我们设计了一种高效的微调方案,将推理能力从商业LLM转移到较小规模的开源语言模型,确保LIMP能够扩展到数百万条移动记录。此外,我们提出了一种基于Transformer的意图感知移动性预测模型,以有效利用LLM的意图推理能力。在两个真实世界数据集上进行评估,LIMP显著优于基线模型,展示了在下一位置预测中提高的准确性和有效的意图推理。意图感知移动性预测的可解释性突显了我们的LIMP框架在实际应用中的潜力。代码和数据可在https://github.com/tsinghua-fib-lab/LIMP找到。
英文摘要:
Human mobility prediction is essential for applications like urban planning and transportation management, yet it remains challenging due to the complex, often implicit, intentions behind human behavior. Existing models predominantly focus on spatiotemporal patterns, paying less attention to the underlying intentions that govern movements. Recent advancements in large language models (LLMs) offer a promising alternative research angle for integrating commonsense reasoning into mobility prediction. However, it is a non-trivial problem because LLMs are not natively built for mobility intention inference, and they also face scalability issues and integration difficulties with spatiotemporal models. To address these challenges, we propose a novel LIMP (LLMs for Intent-ware Mobility Prediction) framework. Specifically, LIMP introduces an "Analyze-Abstract-Infer" (A2I) agentic workflow to unleash LLM's commonsense reasoning power for mobility intention inference. Besides, we design an efficient fine-tuning scheme to transfer reasoning power from commercial LLM to smaller-scale, open-source language model, ensuring LIMP's scalability to millions of mobility records. Moreover, we propose a transformer-based intention-aware mobility prediction model to effectively harness the intention inference ability of LLM. Evaluated on two real-world datasets, LIMP significantly outperforms baseline models, demonstrating improved accuracy in next-location prediction and effective intention inference. The interpretability of intention-aware mobility prediction highlights our LIMP framework's potential for real-world applications. Codes and data can be found in https://github.com/tsinghua-fib-lab/LIMP .
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。