TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learning
University of Georgia(佐治亚大学);UC Santa Barbara(加利福尼亚大学圣巴巴拉分校);University of Texas at Austin(德克萨斯大学奥斯汀分校);UC Davis(加利福尼亚大学戴维斯分校);Basis Independent Fremont(贝西斯独立弗里蒙特分校);Google LLC(谷歌公司);Stanford University(斯坦福大学);Microsoft Research(微软研究院)
Nemin Wu, Qian Cao, Zhangyu Wang, Zeping Liu, Yanlin Qi, Jielu Zhang, Joshua Ni, Xiaobai Yao, Hongxu Ma, Lan Mu, Stefano Ermon, Tanuja Ganu, Akshay Nambi, Ni Lao, Gengchen Mai
备注:
10 pages, 2 figures. Accepted by NeurIPS 2024 Datasets and Benchmarks Track
Spatial representation learning (SRL) aims at learning general-purpose neural network representations from various types of spatial data (e.g., points, polylines, polygons, networks, images, etc.) in their native formats. Learning good spatial representations is a fundamental problem for various downstream applications such as species distribution modeling, weather forecasting, trajectory generation, geographic question answering, etc. Even though SRL has become the foundation of almost all geospatial artificial intelligence (GeoAI) research, we have not yet seen significant efforts to develop an extensive deep learning framework and benchmark to support SRL model development and evaluation. To fill this gap, we propose TorchSpatial, a learning framework and benchmark for location (point) encoding, which is one of the most fundamental data types of spatial representation learning. TorchSpatial contains three key components: 1) a unified location encoding framework that consolidates 15 commonly recognized location encoders, ensuring scalability and reproducibility of the implementations; 2) the LocBench benchmark tasks encompassing 7 geo-aware image classification and 10 geo-aware image regression datasets; 3) a comprehensive suite of evaluation metrics to quantify geo-aware model's overall performance as well as their geographic bias, with a novel Geo-Bias Score metric. Finally, we provide a detailed analysis and insights into the model performance and geographic bias of different location encoders. We believe TorchSpatial will foster future advancement of spatial representation learning and spatial fairness in GeoAI research. The TorchSpatial model framework and LocBench benchmark are available at https://github.com/seai-lab/TorchSpatial, and the Geo-Bias Score evaluation framework is available at https://github.com/seai-lab/PyGBS.
为二维空间中的点生成学习友好的表示是机器学习中的一个基本且长期存在的问题。最近,提出了多尺度编码方案(诸如Space 2 Vec)以将2D空间中的任何点直接编码为高维向量,并且已成功地应用于各种(地理)空间预测任务。然而,当将位置编码模型应用于大规模真实世界GPS坐标数据集(例如,在世界各地拍摄的物种图像)-所有当前位置编码模型被设计用于编码2D(欧几里德)空间中的点而不是球面上的点,例如,地球表面为了解决这个问题,我们提出了一个多尺度的位置编码模型称为Sphere 2 V ec直接编码点坐标在一个球面上,同时避免了mapprojection失真问题。我们提供了理论证明,Sphere 2 Vec编码保留了任何两点之间的球面距离。我们还开发了一个统一的观点,基于双傅立叶球(DFS)的球面上的距离保留编码。我们将Sphere 2 V ec应用于地理感知的图像分类任务。我们的分析表明,球体2 V ec优于其他二维空间定位编码器模型,特别是在极区和数据稀疏的地区,图像分类任务,因为它的性质,球面距离的保护。
NeuroLoc: Encoding Navigation Cells for 6-DOF Camera Localization
Software Engineering Institute, East China Normal University(华东师范大学软件工程学院);School of Geospatial Information, Information Engineering University(信息工程大学地理信息学院);University of Shanghai for Science and Technology(上海科技大学);Fujian (Quanzhou) Institute of Advanced Manufacturing Technology, China(福建(泉州)先进制造技术研究院)
Cornell University(康奈尔大学);Weill Cornell Medicine(威尔康奈尔医学院);Brain and Mind Research Institute(脑与思维研究所);Nancy E. and Peter C. Meinig School of Biomedical Engineering(南希·E·和彼得·C·迈尼希生物医学工程学院)
An Interpretable Implicit-Based Approach for Modeling Local Spatial Effects: A Case Study of Global Gross Primary Productivity
College of Urban and Environmental Sciences, Peking University(北京大学城市与环境学院);The Hong Kong Polytechnic University(香港理工大学);School of Safety Science, Tsinghua University(清华大学安全科学学院);College of Surveying and Geo-Informatics, Tongji University(同济大学测绘与地理信息学院);School of Architecture and Urban Planning, Shenzhen University(深圳大学建筑与城市规划学院)
Diffusion-Encoding Gaussian Field for Joint k-q dMRI Reconstruction
School of Information Engineering, Nanchang University(南昌大学信息工程学院);Academy of Medical Engineering and Translational Medicine, Medical School, Faculty of Medicine, Tianjin University(天津大学医学院医学工程与转化医学研究院);Research Center for Medical AI, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院医学人工智能研究中心)