arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.01855cs.IRcs.AI
收藏

下一步去哪:LLM在下一个POI推荐中的零样本泛化

Where to Move Next: Zero-shot Generalization of LLMs for Next POI Recommendation

Centre for Frontier AI Research(前沿人工智能研究中心);Institute of High Performance Computing(高性能计算研究所);A*STAR(新加坡科技研究局);Nanyang Technological University(南洋理工大学);Hong Kong Polytechnic University(香港理工大学)

Shanshan Feng, Haoming Lyu, Caishun Chen, Yew-Soon Ong

AI总结:

本研究针对LLM在下一个POI推荐中的零样本泛化能力,设计了新颖的提示策略,将推荐任务表述为排序问题,考虑用户地理偏好、空间距离和顺序转移,并在真实数据集上验证了LLM的零样本推荐能力及其对地理上下文理解的局限性。

摘要:

下一个兴趣点(POI)推荐为用户探索周边环境提供了有价值的建议。现有研究依赖于从大规模用户签到数据中构建推荐模型,这些模型是特定于任务的,且需要大量计算资源。最近,预训练大型语言模型(LLM)在各种NLP任务中取得了显著进展,并在推荐场景中也被研究。然而,LLM的泛化能力在解决下一个POI推荐方面仍未被探索,其中需要提取用户的地理移动模式。尽管有研究利用LLM进行下一项推荐,但它们未能考虑地理影响和顺序转移。因此,它们无法有效解决下一个POI推荐任务。为此,我们设计了新颖的提示策略,并进行了实证研究以评估LLM(例如ChatGPT)预测用户下一次签到的能力。具体来说,我们考虑了人类移动行为中的几个关键因素,包括用户地理偏好、空间距离和顺序转移,并将推荐任务表述为排序问题。通过在两个广泛使用的真实世界数据集上进行大量实验,我们得出了几个关键发现。实证评估表明,LLM具有有前景的零样本推荐能力,并能提供准确且合理的预测。我们还揭示了LLM无法准确理解地理上下文信息,并且对候选POI的呈现顺序敏感,这表明了LLM的局限性,并需要进一步研究鲁棒的人类移动推理机制。

英文摘要:

Next Point-of-interest (POI) recommendation provides valuable suggestions for users to explore their surrounding environment. Existing studies rely on building recommendation models from large-scale users' check-in data, which is task-specific and needs extensive computational resources. Recently, the pretrained large language models (LLMs) have achieved significant advancements in various NLP tasks and have also been investigated for recommendation scenarios. However, the generalization abilities of LLMs still are unexplored to address the next POI recommendations, where users' geographical movement patterns should be extracted. Although there are studies that leverage LLMs for next-item recommendations, they fail to consider the geographical influence and sequential transitions. Hence, they cannot effectively solve the next POI recommendation task. To this end, we design novel prompting strategies and conduct empirical studies to assess the capability of LLMs, e.g., ChatGPT, for predicting a user's next check-in. Specifically, we consider several essential factors in human movement behaviors, including user geographical preference, spatial distance, and sequential transitions, and formulate the recommendation task as a ranking problem. Through extensive experiments on two widely used real-world datasets, we derive several key findings. Empirical evaluations demonstrate that LLMs have promising zero-shot recommendation abilities and can provide accurate and reasonable predictions. We also reveal that LLMs cannot accurately comprehend geographical context information and are sensitive to the order of presentation of candidate POIs, which shows the limitations of LLMs and necessitates further research on robust human mobility reasoning mechanisms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑