Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networks
Wageningen University(瓦赫宁根大学);Microsoft Research New England(微软研究院新英格兰分部);Harvard Data Science Initiative(哈佛大学数据科学倡议);Center for Research on Computation and Society(计算与社会研究中心);University of Colorado, Boulder(科罗拉多大学博尔德分校);École Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院)
Marc Rußwurm, Konstantin Klemmer, Esther Rolf, Robin Zbinden, Devis Tuia
Learning representations of geographical space is vital for any machine learning model that integrates geolocated data, spanning application domains such as remote sensing, ecology, or epidemiology. Recent work embeds coordinates using sine and cosine projections based on Double Fourier Sphere (DFS) features. These embeddings assume a rectangular data domain even on global data, which can lead to artifacts, especially at the poles. At the same time, little attention has been paid to the exact design of the neural network architectures with which these functional embeddings are combined. This work proposes a novel location encoder for globally distributed geographic data that combines spherical harmonic basis functions, natively defined on spherical surfaces, with sinusoidal representation networks (SirenNets) that can be interpreted as learned Double Fourier Sphere embedding. We systematically evaluate positional embeddings and neural network architectures across various benchmarks and synthetic evaluation datasets. In contrast to previous approaches that require the combination of both positional encoding and neural networks to learn meaningful representations, we show that both spherical harmonics and sinusoidal representation networks are competitive on their own but set state-of-the-art performances across tasks when combined. The model code and experiments are available at https://github.com/marccoru/locationencoder.
Alternative positional encoding functions for neural transformers
Department of Computer Languages and Computer Science University of Málaga(计算机语言与计算机科学系马拉加大学);Department of Systems Engineering and Automation University of Málaga(系统工程与自动化系马拉加大学);ITIS Software. Universidad de Málaga(ITIS软件. 马拉加大学)
Localized, High-resolution Geographic Representations with Slepian Functions
Department of Computer Science, University of Colorado Boulder(科罗拉多大学波德分校计算机科学系);Microsoft(微软公司);University College London(伦敦大学学院);McGill University(麦吉尔大学);Mila–Quebec AI Institute(魁北克AI研究所);University of Bonn, Germany(德国波恩大学);University of Wageningen, Netherlands(荷兰瓦赫宁根大学)
SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagery
Microsoft Research New England(微软研究院新英格兰分部);University of Colorado Boulder(科罗拉多大学博尔德分校);Harvard University(哈佛大学);Microsoft AI for Good Research Lab(微软AI公益研究实验室);Wageningen University(瓦赫宁根大学)
National University of Singapore(新加坡国立大学);Center for AI Research, VinUniversity(Vin大学人工智能研究中心);Independent Researcher(独立研究者);Hanoi University of Science and Technology(河内科学技术大学)
An Interpretable Implicit-Based Approach for Modeling Local Spatial Effects: A Case Study of Global Gross Primary Productivity
College of Urban and Environmental Sciences, Peking University(北京大学城市与环境学院);The Hong Kong Polytechnic University(香港理工大学);School of Safety Science, Tsinghua University(清华大学安全科学学院);College of Surveying and Geo-Informatics, Tongji University(同济大学测绘与地理信息学院);School of Architecture and Urban Planning, Shenzhen University(深圳大学建筑与城市规划学院)
Time-aware UNet and super-resolution deep residual networks for spatial downscaling
Department of Mathematics and Statistics(数学与统计学系);University of Jyväskylä(于韦斯屈莱大学);Department of Economic Sciences(经济科学系);University of Salento(萨伦托大学);National Centre for HPC, Big Data and Quantum Computing(高性能计算、大数据与量子计算国家中心);National Biodiversity Future Center(国家生物多样性未来中心);University of Helsinki(赫尔辛基大学)
Implicit neural representations for accurate estimation of the standard model of white matter
Department of Computer Science and Mathematics, Eindhoven University of Technology(埃因霍温理工大学计算机科学与数学系);Center for Image Sciences, University Medical Center Utrecht(乌得勒支大学医学中心图像科学中心);Cardiff University Brain Research Imaging Centre (CUBRIC), School of Physics and Astronomy, Cardiff University(卡迪夫大学脑研究成像中心(CUBRIC),物理与天文学学院,卡迪夫大学)