基于网格单元的空间特征分布多尺度表示学习
Multi-Scale Representation Learning for Spatial Feature Distributions using Grid Cells
摘要:
无监督文本编码模型最近推动了NLP的实质性进展。其核心思想是使用神经网络将文本中的单词转换为基于句子中单词位置及其上下文的向量空间表示,这适用于下游任务的端到端训练。我们在空间分析中看到了一个惊人的相似情况,它专注于将地理对象(如POI)的绝对位置和空间背景结合到模型中。一个通用的空间表示模型对于许多任务都是有价值的。然而,没有这样的通用模型存在的日期,除了简单地应用离散化或前馈网络的坐标,并很少努力已经投入到联合建模分布有很大的不同特点,这通常出现在GIS数据。与此同时,获得诺贝尔奖的神经科学研究表明,哺乳动物的网格细胞提供了一种多尺度的周期性表示,它可以作为位置编码的度量标准,对于识别位置和路径整合至关重要。因此,我们提出了一个表示学习模型称为Space2Vec编码的绝对位置和空间关系的地方。我们对两个真实世界的地理数据进行实验,用于两个不同的任务:1)根据位置和上下文预测POI的类型,2)利用地理位置进行图像分类。结果表明,由于其多尺度表示,Space2Vec在位置建模和图像分类任务方面优于成熟的ML方法,如RBF内核,多层前馈网络和瓦片嵌入方法。详细的分析表明,所有基线最多可以很好地处理一个尺度上的分布,但在其他尺度上表现不佳。相比之下,Space2Vec的多尺度表示可以处理不同尺度的分布。
英文摘要:
Unsupervised text encoding models have recently fueled substantial progress in NLP. The key idea is to use neural networks to convert words in texts to vector space representations based on word positions in a sentence and their contexts, which are suitable for end-to-end training of downstream tasks. We see a strikingly similar situation in spatial analysis, which focuses on incorporating both absolute positions and spatial contexts of geographic objects such as POIs into models. A general-purpose representation model for space is valuable for a multitude of tasks. However, no such general model exists to date beyond simply applying discretization or feed-forward nets to coordinates, and little effort has been put into jointly modeling distributions with vastly different characteristics, which commonly emerges from GIS data. Meanwhile, Nobel Prize-winning Neuroscience research shows that grid cells in mammals provide a multi-scale periodic representation that functions as a metric for location encoding and is critical for recognizing places and for path-integration. Therefore, we propose a representation learning model called Space2Vec to encode the absolute positions and spatial relationships of places. We conduct experiments on two real-world geographic data for two different tasks: 1) predicting types of POIs given their positions and context, 2) image classification leveraging their geo-locations. Results show that because of its multi-scale representations, Space2Vec outperforms well-established ML approaches such as RBF kernels, multi-layer feed-forward nets, and tile embedding approaches for location modeling and image classification tasks. Detailed analysis shows that all baselines can at most well handle distribution at one scale but show poor performances in other scales. In contrast, Space2Vec's multi-scale representation can handle distributions at different scales.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。