arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.03751cs.CV
收藏

视觉地点识别中测试时参考集被忽视的价值

The Overlooked Value of Test-time Reference Sets in Visual Place Recognition

TU Delft(代尔夫特理工大学);CMU(卡内基梅隆大学)

Mubariz Zaffar, Liangliang Nan, Sebastian Scherer, Julian F. P. Kooij

AI总结:

针对测试环境与训练数据差异大导致VPR性能下降的问题,提出利用测试时参考集对VPR模型进行参考集微调,提升了挑战性基准上的SOTA性能且保持泛化能力。

摘要:

视觉地点识别(VPR)的任务是:给定一张查询图像,从参考数据库中检索出同一地点的图像,且对视角和外观变化具有鲁棒性。近期研究表明,一些VPR基准测试中的部分基准已被采用视觉基础模型(Vision-Foundation-Model)骨干网络、并在大规模多样化VPR专属数据集上训练的方法攻克。但仍有若干基准颇具挑战,尤其是当测试环境与常规VPR训练数据集差异显著时难度更高。我们提出一种尚未被探索的补充信息源来弥合训练-测试域差距,可进一步提升当前最优(SOTA)VPR方法在这类挑战性基准上的性能。具体而言,我们发现测试时参考集(即“地图”)包含目标域的图像和位姿,且在多个VPR应用场景中,测试时查询收到前该参考集必然可用。因此我们提出对VPR模型在地图上进行简单的参考集微调(Reference-Set-Finetuning, RSF),在这些挑战性数据集上将SOTA性能提升(Recall@1平均提升约2.3%)。微调后的模型仍保持泛化能力,且RSF在多种测试数据集上均有效。

英文摘要:

Given a query image, Visual Place Recognition (VPR) is the task of retrieving an image of the same place from a reference database with robustness to viewpoint and appearance changes. Recent works show that some VPR benchmarks are solved by methods using Vision-Foundation-Model backbones and trained on large-scale and diverse VPR-specific datasets. Several benchmarks remain challenging, particularly when the test environments differ significantly from the usual VPR training datasets. We propose a complementary, unexplored source of information to bridge the train-test domain gap, which can further improve the performance of State-of-the-Art (SOTA) VPR methods on such challenging benchmarks. Concretely, we identify that the test-time reference set, the "map", contains images and poses of the target domain, and must be available before the test-time query is received in several VPR applications. Therefore, we propose to perform simple Reference-Set-Finetuning (RSF) of VPR models on the map, boosting the SOTA (~2.3% increase on average for Recall@1) on these challenging datasets. Finetuned models retain generalization, and RSF works across diverse test datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑