arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.02408cs.CVcs.AI

使用去噪扩散模型的多天气跨视角地理定位

Multi-weather Cross-view Geo-localization Using Denoising Diffusion Models

Tsinghua University(清华大学);BNRist, Tsinghua University(清华大学BNRist);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)

Tongtong Feng, Qing Li, Xin Wang, Mingzi Wang, Guangyao Li, Wenwu Zhu

AI总结:

本文提出MCGF框架,利用去噪扩散模型联合优化图像恢复与地理定位,通过共享编码器和EVA-02主干网络消除天气干扰,在多天气条件下实现了有竞争力的跨视角地理定位性能。

摘要:

GNSS拒止环境下的跨视角地理定位旨在通过将无人机视角图像与大型图库中正确的带有地理标签的卫星视角图像进行匹配来确定未知位置。近期研究表明,在特定天气条件下学习判别性图像表示能显著提升性能。然而,未见过的极端天气的频繁出现阻碍了进展。本文提出MCGF,一个旨在动态适应未见天气条件的多天气跨视角地理定位框架。MCGF利用去噪扩散模型在图像恢复与地理定位之间建立联合优化。在图像恢复方面,MCGF结合共享编码器和轻量级恢复模块,帮助主干网络消除特定天气信息。在地理定位方面,MCGF采用EVA-02作为特征提取主干,使用交叉熵损失进行训练,并使用余弦距离进行测试。在University160k-WX上的大量实验表明,MCGF在不同天气条件下的地理定位中取得了有竞争力的结果。

英文摘要:

Cross-view geo-localization in GNSS-denied environments aims to determine an unknown location by matching drone-view images with the correct geo-tagged satellite-view images from a large gallery. Recent research shows that learning discriminative image representations under specific weather conditions can significantly enhance performance. However, the frequent occurrence of unseen extreme weather conditions hinders progress. This paper introduces MCGF, a Multi-weather Cross-view Geo-localization Framework designed to dynamically adapt to unseen weather conditions. MCGF establishes a joint optimization between image restoration and geo-localization using denoising diffusion models. For image restoration, MCGF incorporates a shared encoder and a lightweight restoration module to help the backbone eliminate weather-specific information. For geo-localization, MCGF uses EVA-02 as a backbone for feature extraction, with cross-entropy loss for training and cosine distance for testing. Extensive experiments on University160k-WX demonstrate that MCGF achieves competitive results for geo-localization in varying weather conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑