arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.15658cs.CVcs.AI
收藏

TorchSpatial:面向空间表示学习的位置编码框架与基准

TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learning

University of Georgia(佐治亚大学);UC Santa Barbara(加利福尼亚大学圣巴巴拉分校);University of Texas at Austin(德克萨斯大学奥斯汀分校);UC Davis(加利福尼亚大学戴维斯分校);Basis Independent Fremont(贝西斯独立弗里蒙特分校);Google LLC(谷歌公司);Stanford University(斯坦福大学);Microsoft Research(微软研究院)

Nemin Wu, Qian Cao, Zhangyu Wang, Zeping Liu, Yanlin Qi, Jielu Zhang, Joshua Ni, Xiaobai Yao, Hongxu Ma, Lan Mu, Stefano Ermon, Tanuja Ganu, Akshay Nambi, Ni Lao, Gengchen Mai

AI总结:

TorchSpatial提出统一位置编码框架与LocBench基准,整合15个编码器、17个地理感知数据集及Geo-Bias Score指标,推动空间表示学习与公平性研究。

摘要:

空间表示学习(SRL)旨在从各种类型的空间数据(如点、折线、多边形、网络、图像等)的原生格式中学习通用的神经网络表示。学习良好的空间表示是物种分布建模、天气预报、轨迹生成、地理问答等各种下游应用的基础问题。尽管SRL已成为几乎所有地理空间人工智能(GeoAI)研究的基础,但我们尚未看到为支持SRL模型开发和评估而开发广泛深度学习框架和基准的重大努力。为填补这一空白,我们提出了TorchSpatial,一个用于位置(点)编码的学习框架和基准,这是空间表示学习中最基本的数据类型之一。TorchSpatial包含三个关键组成部分:1)一个统一的位置编码框架,整合了15个公认的位置编码器,确保实现的可扩展性和可复现性;2)LocBench基准任务,包含7个地理感知图像分类和10个地理感知图像回归数据集;3)一套全面的评估指标,用于量化地理感知模型的整体性能及其地理偏差,并引入新颖的Geo-Bias Score指标。最后,我们对不同位置编码器的模型性能和地理偏差提供了详细分析和见解。我们相信TorchSpatial将推动GeoAI研究中空间表示学习和空间公平性的未来发展。TorchSpatial模型框架和LocBench基准可在https://github.com/seai-lab/TorchSpatial获取,Geo-Bias Score评估框架可在https://github.com/seai-lab/PyGBS获取。

英文摘要:

Spatial representation learning (SRL) aims at learning general-purpose neural network representations from various types of spatial data (e.g., points, polylines, polygons, networks, images, etc.) in their native formats. Learning good spatial representations is a fundamental problem for various downstream applications such as species distribution modeling, weather forecasting, trajectory generation, geographic question answering, etc. Even though SRL has become the foundation of almost all geospatial artificial intelligence (GeoAI) research, we have not yet seen significant efforts to develop an extensive deep learning framework and benchmark to support SRL model development and evaluation. To fill this gap, we propose TorchSpatial, a learning framework and benchmark for location (point) encoding, which is one of the most fundamental data types of spatial representation learning. TorchSpatial contains three key components: 1) a unified location encoding framework that consolidates 15 commonly recognized location encoders, ensuring scalability and reproducibility of the implementations; 2) the LocBench benchmark tasks encompassing 7 geo-aware image classification and 10 geo-aware image regression datasets; 3) a comprehensive suite of evaluation metrics to quantify geo-aware model's overall performance as well as their geographic bias, with a novel Geo-Bias Score metric. Finally, we provide a detailed analysis and insights into the model performance and geographic bias of different location encoders. We believe TorchSpatial will foster future advancement of spatial representation learning and spatial fairness in GeoAI research. The TorchSpatial model framework and LocBench benchmark are available at https://github.com/seai-lab/TorchSpatial, and the Geo-Bias Score evaluation framework is available at https://github.com/seai-lab/PyGBS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑