arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.09493cs.CV
收藏

RIFT:基于辐射不变特征变换的多模态图像匹配

RIFT: Multi-modal Image Matching Based on Radiation-invariant Feature Transform

Jiayuan Li, Qingwu Hu, Mingyao Ai

摘要:

传统的特征匹配方法如尺度不变特征变换(SIFT)通常使用图像的强度或梯度信息来检测和描述特征点,但强度和梯度对非线性辐射畸变(NRD)都很敏感。为了解决这个问题,本文提出了一种新的特征匹配算法,是强大的大NRD。该方法被称为辐射不变特征变换(RIFT)。RIFT的主要贡献有三个:第一,RIFT使用相位一致性(PC)代替图像强度来检测特征点。RIFT同时考虑特征点的数量和重复性,并检测PC地图上的角点和边缘点。第二,RIFT最初提出了一个最大索引图(MIM)的特征描述。MIM是由log-Gabor卷积序列构造的,比传统的梯度映射对NRD具有更强的鲁棒性。因此,RIFT不仅大大提高了特征检测的稳定性,而且克服了梯度信息对特征描述的限制。第三,RIFT分析了旋转对MIM值的内在影响,实现了旋转不变性。我们使用六种不同类型的多模型图像数据集来评估RIFT,包括光学-光学、红外-光学、合成孔径雷达(SAR)-光学、深度-光学、地图-光学和昼夜数据集。实验结果表明,RIFT比SIFT和SAR-SIFT具有更好的性能。据我们所知,RIFT是第一个可以在所有上述类型的多模型图像上实现良好性能的特征匹配算法。公开RIFT和多模态遥感影像数据集的源代码。

英文摘要:

Traditional feature matching methods such as scale-invariant feature transform (SIFT) usually use image intensity or gradient information to detect and describe feature points; however, both intensity and gradient are sensitive to nonlinear radiation distortions (NRD). To solve the problem, this paper proposes a novel feature matching algorithm that is robust to large NRD. The proposed method is called radiation-invariant feature transform (RIFT). There are three main contributions in RIFT: first, RIFT uses phase congruency (PC) instead of image intensity for feature point detection. RIFT considers both the number and repeatability of feature points, and detects both corner points and edge points on the PC map. Second, RIFT originally proposes a maximum index map (MIM) for feature description. MIM is constructed from the log-Gabor convolution sequence and is much more robust to NRD than traditional gradient map. Thus, RIFT not only largely improves the stability of feature detection, but also overcomes the limitation of gradient information for feature description. Third, RIFT analyzes the inherent influence of rotations on the values of MIM, and realizes rotation invariance. We use six different types of multi-model image datasets to evaluate RIFT, including optical-optical, infrared-optical, synthetic aperture radar (SAR)-optical, depth-optical, map-optical, and day-night datasets. Experimental results show that RIFT is much more superior to SIFT and SAR-SIFT. To the best of our knowledge, RIFT is the first feature matching algorithm that can achieve good performance on all the above-mentioned types of multi-model images. The source code of RIFT and multi-modal remote sensing image datasets are made public .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑