arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.07003cs.CV
收藏

AstroLoc:鲁棒的空间对地图像定位器

AstroLoc: Robust Space to Ground Image Localizer

Politecnico di Torino(托里尼.politecnico大学);Amazon(亚马逊)

Gabriele Berton, Alex Stoken, Carlo Masone

AI总结:

针对现有宇航员摄影定位方法仅用卫星图像训练的局限,提出首个利用30万张弱标记宇航员照片训练的AstroLoc模型,通过双损失函数学习鲁棒特征,recall@1较SOTA提升35%,还可直接用于相关定位任务。

摘要:

宇航员每天从国际空间站拍摄数千张地球照片,这些照片一旦在地球表面完成定位,便可用于从气候变化研究到灾害管理等诸多任务。数十年来,定位工作一直由人工完成,近期研究者开始采用图像检索方案解决该问题:给定一张宇航员拍摄的照片,在带有地理标签的大型卫星图像数据库中找到最相似的匹配项,这一任务被称为宇航员摄影定位(Astronaut Photography Localization,APL)。然而,现有APL方法仅使用卫星图像进行训练,未能利用数百万张开源宇航员照片。在本研究中,我们提出了首个能够利用宇航员照片进行训练的APL流水线。我们首先通过自动化流水线,为30万张人工弱标记的宇航员照片生成完整的定位信息,随后利用这些图像训练名为AstroLoc的模型。AstroLoc通过两种损失函数学习地球表面特征的鲁棒表示:一是配对损失,将宇航员照片与其匹配的对应卫星图像配对计算;二是针对卫星图像聚类的损失,通过无监督挖掘,根据聚类与宇航员摄影的相关性赋予权重。我们发现,AstroLoc的recall@1(召回率@1)较此前的最优水平(SOTA)平均提升了35%,突破了现有数据集的性能极限,其recall@100(召回率@100)始终超过99%。最后我们注意到,无需任何微调,AstroLoc就能在“太空迷失”卫星问题、历史航天图像定位等相关任务上取得优异结果。

英文摘要:

Astronauts take thousands of photos of Earth per day from the International Space Station, which, once localized on Earth's surface, are used for a multitude of tasks, ranging from climate change research to disaster management. The localization process, which has been performed manually for decades, has recently been approached through image retrieval solutions: given an astronaut photo, find its most similar match among a large database of geo-tagged satellite images, in a task called Astronaut Photography Localization (APL). Yet, existing APL approaches are trained only using satellite images, without taking advantage of the millions open-source astronaut photos. In this work we present the first APL pipeline capable of leveraging astronaut photos for training. We first produce full localization information for 300,000 manually weakly labeled astronaut photos through an automated pipeline, and then use these images to train a model, called AstroLoc. AstroLoc learns a robust representation of Earth's surface features through two losses: astronaut photos paired with their matching satellite counterparts in a pairwise loss, and a second loss on clusters of satellite imagery weighted by their relevance to astronaut photography via unsupervised mining. We find that AstroLoc achieves a staggering 35% average improvement in recall@1 over previous SOTA, pushing the limits of existing datasets with a recall@100 consistently over 99%. Finally, we note that AstroLoc, without any fine-tuning, provides excellent results for related tasks like the lost-in-space satellite problem and historical space imagery localization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑