arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.06229cs.AI
收藏

基于POI数据的城市空间表示多模态对比学习

Multimodal Contrastive Learning of Urban Space Representations from POI Data

University College London(伦敦大学学院);University of Surrey(萨里大学)

Xinglei Wang, Tao Cheng, Stephen Law, Zichao Zeng, Lu Yin, Junyuan Liu

AI总结:

针对现有POI城市空间表示方法的局限,提出多模态对比学习模型CaLLiPer,通过将位置嵌入与文本描述对齐直接学习连续空间表示,在伦敦的预测任务中性能提升5-15%,且训练效率更高。

摘要:

从兴趣点(POI)数据中学习城市空间表示的现有方法面临若干局限性,包括地理划分问题、空间信息建模不充分、POI语义属性利用不足以及计算效率低下。为了解决这些问题,我们提出了CaLLiPer(Contrastive Language-Location Pre-training,对比语言-位置预训练),这是一种新颖的表示学习模型,能够将连续的城市空间直接嵌入为向量表示,从而捕捉城市环境的空间和语义分布。该模型利用多模态对比学习目标,将位置嵌入与文本POI描述进行对齐,从而避免了复杂的训练语料库构建和负采样。我们通过将其应用于英国伦敦的城市空间表示学习来验证CaLLiPer的有效性,与最先进的方法相比,它在土地利用分类和社会经济制图任务的预测性能上提升了5-15%。学习到的表示的可视化进一步展示了我们的模型在以高精度和细分辨率捕捉城市语义的空间变化方面的优势。此外,CaLLiPer减少了训练时间,展示了其高效性和可扩展性。这项工作为可扩展、语义丰富的城市空间表示学习提供了一条有前景的途径,能够支持地理空间基础模型的开发。实现代码可在https://github.com/xlwang233/CaLLiPer获取。

英文摘要:

Existing methods for learning urban space representations from Point-of-Interest (POI) data face several limitations, including issues with geographical delineation, inadequate spatial information modelling, underutilisation of POI semantic attributes, and computational inefficiencies. To address these issues, we propose CaLLiPer (Contrastive Language-Location Pre-training), a novel representation learning model that directly embeds continuous urban spaces into vector representations that can capture the spatial and semantic distribution of urban environment. This model leverages a multimodal contrastive learning objective, aligning location embeddings with textual POI descriptions, thereby bypassing the need for complex training corpus construction and negative sampling. We validate CaLLiPer's effectiveness by applying it to learning urban space representations in London, UK, where it demonstrates 5-15% improvement in predictive performance for land use classification and socioeconomic mapping tasks compared to state-of-the-art methods. Visualisations of the learned representations further illustrate our model's advantages in capturing spatial variations in urban semantics with high accuracy and fine resolution. Additionally, CaLLiPer achieves reduced training time, showcasing its efficiency and scalability. This work provides a promising pathway for scalable, semantically rich urban space representation learning that can support the development of geospatial foundation models. The implementation code is available at https://github.com/xlwang233/CaLLiPer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑