arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.00583cs.DBcs.AI
收藏

从OpenStreetMap中学习通用表示的城市基础模型

City Foundation Models for Learning General Purpose Representations from OpenStreetMap

Nanyang Technological University(南洋理工大学)

Pasquale Balsebre, Weiming Huang, Gao Cong, Yi Li

AI总结:

提出自监督框架CityFM,利用OpenStreetMap开放数据训练城市基础模型,生成融合空间、视觉和文本信息的多模态表示,在道路、建筑和区域级下游任务中表现优于或持平基线。

摘要:

预训练基础模型(PFMs)因其能够学习可广泛应用于各种下游任务的通用表示,在人工智能领域引发了一场范式转变。尽管PFMs已成功应用于自然语言处理和计算机视觉等领域,但其在处理地理空间数据和解答城市问题方面的能力仍然有限。这归因于地理空间数据的内在异质性,它包含不同的数据类型,如点、线段和区域,以及多种信息模态,如空间位置、视觉特征和文本标注。志愿者地理信息计划的普及,以及像OpenStreetMap这样全球免费访问的开放地理空间数据源日益增加的可用性,揭示了弥合这一差距的宝贵机会。在本文中,我们提出了CityFM,这是一个自监督框架,用于在选定的感兴趣地理区域(如城市)内训练基础模型。CityFM仅依赖来自OSM的开放数据,生成不同类型实体的多模态表示,融合了空间、视觉和文本信息。我们从定性角度分析了使用我们的基础模型生成的实体表示,并在道路、建筑和区域级别的下游任务上进行了定量实验。我们将其结果与专为各自应用定制的算法进行了比较。在所有实验中,CityFM的性能均优于或与基线方法持平。

英文摘要:

Pre-trained Foundation Models (PFMs) have ushered in a paradigm-shift in Artificial Intelligence, due to their ability to learn general-purpose representations that can be readily employed in a wide range of downstream tasks. While PFMs have been successfully adopted in various fields such as Natural Language Processing and Computer Vision, their capacity in handling geospatial data and answering urban questions remains limited. This can be attributed to the intrinsic heterogeneity of geospatial data, which encompasses different data types, including points, segments and regions, as well as multiple information modalities, such as a spatial position, visual characteristics and textual annotations. The proliferation of Volunteered Geographic Information initiatives, and the ever-increasing availability of open geospatial data sources, like OpenStreetMap, which is freely accessible globally, unveil a promising opportunity to bridge this gap. In this paper, we present CityFM, a self-supervised framework to train a foundation model within a selected geographical area of interest, such as a city. CityFM relies solely on open data from OSM, and produces multimodal representations of entities of different types, incorporating spatial, visual, and textual information. We analyse the entity representations generated using our foundation models from a qualitative perspective, and conduct quantitative experiments on road, building, and region-level downstream tasks. We compare its results to algorithms tailored specifically for the respective applications. In all the experiments, CityFM achieves performance superior to, or on par with, the baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑