arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.11646cs.CVcs.LG
收藏

每个部分都很重要:本地模式有助于跨视图地理定位

Each Part Matters: Local Patterns Facilitate Cross-view Geo-localization

Hangzhou Dianzi University(杭州电子科技大学);Australian Artificial Intelligence Institute(澳大利亚人工智能研究所);University of Technology Sydney(悉尼科技大学)

Tingyu Wang, Zhedong Zheng, Chenggang Yan, Jiyong Zhang, Yaoqi Sun, Bolun Zheng, Yi Yang

摘要:

跨视图地理定位是从不同平台发现同一地理目标的图像,例如,无人机监控摄像头和卫星这是具有挑战性的,在大的视觉外观变化所造成的极端的观点变化。现有的方法通常集中于挖掘图像中心的地理目标的细粒度特征,而低估了相邻区域的上下文信息。在这项工作中,我们认为,邻近地区可以利用作为辅助信息,丰富的地理定位的判别线索。具体来说,我们引入了一个简单有效的深度神经网络,称为本地模式网络(LPN),以端到端的方式利用上下文信息。在不使用额外部分估计的情况下,LPN采用方环特征划分策略,根据到图像中心的距离提供注意力。它简化了零件匹配并支持零件式表示学习。由于采用了方环分区设计,该LPN对旋转变化具有良好的可扩展性,并在三个主流基准测试中取得了有竞争力的结果,即,大学-1652年,CVUSA和CVACT。此外,我们还表明,建议的LPN可以很容易地嵌入到其他框架,以进一步提高性能。

英文摘要:

Cross-view geo-localization is to spot images of the same geographic target from different platforms, e.g., drone-view cameras and satellites. It is challenging in the large visual appearance changes caused by extreme viewpoint variations. Existing methods usually concentrate on mining the fine-grained feature of the geographic target in the image center, but underestimate the contextual information in neighbor areas. In this work, we argue that neighbor areas can be leveraged as auxiliary information, enriching discriminative clues for geolocalization. Specifically, we introduce a simple and effective deep neural network, called Local Pattern Network (LPN), to take advantage of contextual information in an end-to-end manner. Without using extra part estimators, LPN adopts a square-ring feature partition strategy, which provides the attention according to the distance to the image center. It eases the part matching and enables the part-wise representation learning. Owing to the square-ring partition design, the proposed LPN has good scalability to rotation variations and achieves competitive results on three prevailing benchmarks, i.e., University-1652, CVUSA and CVACT. Besides, we also show the proposed LPN can be easily embedded into other frameworks to further boost performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑