arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.03544cs.AIcs.CL
收藏

面向基于语言的人类移动性预测的提示挖掘

Prompt Mining for Language-based Human Mobility Forecasting

University of New South Wales(新南威尔士大学);Cisco Systems Inc.(思科系统公司)

Hao Xue, Tianye Tang, Ali Payani, Flora D. Salim

AI总结:

针对基于语言的人类移动性预测中固定人工提示模板限制模型性能的问题,提出包含基于信息熵的提示生成与思维链等机制的提示优化阶段的提示挖掘框架,实验验证了其有效性,为该领域发展提供新方向。

摘要:

随着大语言模型的发展,基于语言的预测近期成为预测人类移动模式的创新方法。其核心思路是利用提示将以数值形式给出的原始移动数据转换为自然语言句子,从而借助语言模型生成未来观测的描述。然而,以往研究仅采用固定的人工设计模板将数值转换为句子。由于语言模型的预测性能高度依赖提示,使用固定模板进行提示可能会限制语言模型的预测能力。本文提出了一种用于基于语言的移动性预测的提示挖掘新框架,旨在探索多样化的提示设计策略。具体而言,该框架包含基于提示信息熵的提示生成阶段,以及整合思维链等机制的提示优化阶段。在真实世界大规模数据上的实验结果证明了我们的提示挖掘流程生成的提示具有优越性。此外,不同提示变体的对比表明,所提出的提示优化过程是有效的。本研究为进一步推进基于语言的移动性预测提供了一个有前景的方向。

英文摘要:

With the advancement of large language models, language-based forecasting has recently emerged as an innovative approach for predicting human mobility patterns. The core idea is to use prompts to transform the raw mobility data given as numerical values into natural language sentences so that the language models can be leveraged to generate the description for future observations. However, previous studies have only employed fixed and manually designed templates to transform numerical values into sentences. Since the forecasting performance of language models heavily relies on prompts, using fixed templates for prompting may limit the forecasting capability of language models. In this paper, we propose a novel framework for prompt mining in language-based mobility forecasting, aiming to explore diverse prompt design strategies. Specifically, the framework includes a prompt generation stage based on the information entropy of prompts and a prompt refinement stage to integrate mechanisms such as the chain of thought. Experimental results on real-world large-scale data demonstrate the superiority of generated prompts from our prompt mining pipeline. Additionally, the comparison of different prompt variants shows that the proposed prompt refinement process is effective. Our study presents a promising direction for further advancing language-based mobility forecasting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑