早过滤,晚匹配:改进基于网络的视觉位置识别
Filter Early, Match Late: Improving Network-Based Visual Place Recognition
摘要:
随着时间的推移,CNN在执行位置识别方面表现出色,特别是当神经网络在当前环境条件下针对定位进行优化时。在本文中,我们研究了特征图过滤的概念,其中,而不是使用卷积张量中的所有激活,只使用最有用的激活。由于特定的特征图编码不同的视觉特征,因此目标是去除有损于识别外观变化中的位置的能力的特征图。我们的关键创新是在早期卷积层中过滤特征图,然后继续运行网络,并使用同一网络中的后续层提取特征向量。通过过滤早期的视觉特征,并从一个更高的,更多的观点不变的后来层提取的特征向量,我们证明了改进的条件和观点不变性。我们的方法需要从部署环境中训练图像对,但我们表明,只需一个训练图像对就可以定期实现最先进的性能。进行详尽的实验分析,以确定早期层过滤和后期层提取之间的因果关系的全部范围。为了有效性,我们使用三个数据集:Oxford RobotCar、Nordland和Gardens Point,实现了优于NetVLAD的整体性能。这项工作为探索CNN优化提供了许多新的途径,而无需完全重新训练。
英文摘要:
CNNs have excelled at performing place recognition over time, particularly when the neural network is optimized for localization in the current environmental conditions. In this paper we investigate the concept of feature map filtering, where, rather than using all the activations within a convolutional tensor, only the most useful activations are used. Since specific feature maps encode different visual features, the objective is to remove feature maps that are detract from the ability to recognize a location across appearance changes. Our key innovation is to filter the feature maps in an early convolutional layer, but then continue to run the network and extract a feature vector using a later layer in the same network. By filtering early visual features and extracting a feature vector from a higher, more viewpoint invariant later layer, we demonstrate improved condition and viewpoint invariance. Our approach requires image pairs for training from the deployment environment, but we show that state-of-the-art performance can regularly be achieved with as little as a single training image pair. An exhaustive experimental analysis is performed to determine the full scope of causality between early layer filtering and late layer extraction. For validity, we use three datasets: Oxford RobotCar, Nordland, and Gardens Point, achieving overall superior performance to NetVLAD. The work provides a number of new avenues for exploring CNN optimizations, without full re-training.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。