arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.09059cs.CL
收藏

LAMP:地图上的语言模型

LAMP: A Language Model on the Map

Nanyang Technological University(南洋理工大学)

Pasquale Balsebre, Weiming Huang, Gao Cong

AI总结:

本研究提出LAMP框架,通过城市特定数据微调预训练模型,提升LLMs对细粒度地点的检索与推荐能力,减少幻觉,并在日规划中展现涌现能力。

摘要:

大型语言模型(LLMs)将在我们的生活中发挥日益重要的作用,为广泛的任务提供协助。在地理空间领域,LLMs已展现出回答一般性问题的能力,例如识别某个国家的首都;然而,当涉及回答关于特定地点(如杂货店或餐厅)的细粒度问题时,其实用性便受到阻碍,而这些地点构成了人们日常生活的重要方面。这主要是因为我们城市中的地点尚未被系统地输入LLMs,以便其理解和记忆。本研究引入了一种新框架,在城市特定数据上对预训练模型进行微调,使其能够提供准确的推荐,同时最小化幻觉。我们分享了我们的模型LAMP及其训练数据。我们进行了实验,分析其正确检索空间对象的能力,并将其与著名的开源和闭源语言模型(如GPT-4)进行比较。最后,我们通过一个关于日规划的案例研究探索了其涌现能力。

英文摘要:

Large Language Models (LLMs) are poised to play an increasingly important role in our lives, providing assistance across a wide array of tasks. In the geospatial domain, LLMs have demonstrated the ability to answer generic questions, such as identifying a country's capital; nonetheless, their utility is hindered when it comes to answering fine-grained questions about specific places, such as grocery stores or restaurants, which constitute essential aspects of people's everyday lives. This is mainly because the places in our cities haven't been systematically fed into LLMs, so as to understand and memorize them. This study introduces a novel framework for fine-tuning a pre-trained model on city-specific data, to enable it to provide accurate recommendations, while minimizing hallucinations. We share our model, LAMP, and the data used to train it. We conduct experiments to analyze its ability to correctly retrieving spatial objects, and compare it to well-known open- and closed- source language models, such as GPT-4. Finally, we explore its emerging capabilities through a case study on day planning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑