EarthLoc:通过从太空索引地球实现宇航员摄影定位
EarthLoc: Astronaut Photography Localization by Indexing Earth from Space
AI总结:
本文提出基于图像检索的 EarthLoc 模型,结合按年份数据增强和中性感知多重相似度损失,实现宇航员摄影地理范围的自动定位,并通过六个数据集基准验证其效率与精度优势。
摘要:
宇航员摄影跨越六十年的人类航天史,构成了一个独特的地球观测数据集,对科学研究和灾害响应都具有巨大价值。尽管其意义重大,但准确定位这些图像的地理范围(这是有效利用的关键)仍面临巨大挑战。目前的人工定位工作非常耗时,因此迫切需要自动化解决方案。我们提出了一种利用图像检索的新颖方法,以高效应对这一挑战。我们介绍了创新训练技术,包括按年份数据增强(Year-Wise Data Augmentation)和中性感知多重相似度损失(Neutral-Aware Multi-Similarity Loss),这些技术促成了高性能模型 EarthLoc 的开发。我们构建了六个评估数据集,并进行了全面基准测试,将 EarthLoc 与现有方法进行比较,展示了其卓越的效率和准确性。我们的方法标志着宇航员摄影定位自动化的重大进步,将有助于弥合地球观测数据中的一个关键缺口。代码和数据集可在 https://github.com/gmberton/EarthLoc 获取。
英文摘要:
Astronaut photography, spanning six decades of human spaceflight, presents a unique Earth observations dataset with immense value for both scientific research and disaster response. Despite its significance, accurately localizing the geographical extent of these images, crucial for effective utilization, poses substantial challenges. Current manual localization efforts are time-consuming, motivating the need for automated solutions. We propose a novel approach - leveraging image retrieval - to address this challenge efficiently. We introduce innovative training techniques, including Year-Wise Data Augmentation and a Neutral-Aware Multi-Similarity Loss, which contribute to the development of a high-performance model, EarthLoc. We develop six evaluation datasets and perform a comprehensive benchmark comparing EarthLoc to existing methods, showcasing its superior efficiency and accuracy. Our approach marks a significant advancement in automating the localization of astronaut photography, which will help bridge a critical gap in Earth observations data. Code and datasets are available at https://github.com/gmberton/EarthLoc
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。