arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2603.27969cs.CV

Hg-I2P:通过异构图实现通用的图像到点云配准

Hg-I2P: Bridging Modalities for Generalizable Image-to-Point-Cloud Registration via Heterogeneous Graphs

Huazhong University of Science and Technology(华中科技大学);Northwestern Polytechnical University(西北工业大学);Huazhong Agricultural University(华中农业大学);Delft University of Technology(代尔夫特理工大学)

Pei An, Junfeng Ding, Jiaqi Yang, Yulong Wang, Jie Ma, Liangliang Nan

AI总结:

本文提出Hg-I2P方法,通过异构图融合多模态特征,提升图像与点云配准的泛化能力和精度。

摘要:

图像到点云(I2P)配准旨在通过建立可靠的2D-3D对应关系对齐2D图像与3D点云。图像与点云之间显著的模态差距使得学习既具有判别性又具有泛化性的特征极具挑战性,导致在未见场景中性能下降严重。为此,本文引入异构图,通过统一架构细化跨模态特征和对应关系。所提出的图表示了分割后的2D和3D区域之间的映射,增强了跨模态特征交互,从而提高了特征判别性。此外,建模图中顶点和边的一致性能够修剪不可靠的对应关系。基于这些见解,本文提出了一种嵌入异构图的I2P配准方法,称为Hg-I2P。该方法通过挖掘多路径特征关系学习异构图,通过异构边的指导适应特征,并利用基于图的投影一致性修剪对应关系。在六个室内和室外基准测试中,Hg-I2P在泛化性和精度上显著优于现有方法。代码已发布在https://github.com/anpei96/hg-i2p-demo。

英文摘要:

Image-to-point-cloud (I2P) registration aims to align 2D images with 3D point clouds by establishing reliable 2D-3D correspondences. The drastic modality gap between images and point clouds makes it challenging to learn features that are both discriminative and generalizable, leading to severe performance drops in unseen scenarios. We address this challenge by introducing a heterogeneous graph that enables refining both cross-modal features and correspondences within a unified architecture. The proposed graph represents a mapping between segmented 2D and 3D regions, which enhances cross-modal feature interaction and thus improves feature discriminability. In addition, modeling the consistency among vertices and edges within the graph enables pruning of unreliable correspondences. Building on these insights, we propose a heterogeneous graph embedded I2P registration method, termed Hg-I2P. It learns a heterogeneous graph by mining multi-path feature relationships, adapts features under the guidance of heterogeneous edges, and prunes correspondences using graph-based projection consistency. Experiments on six indoor and outdoor benchmarks under cross-domain setups demonstrate that Hg-I2P significantly outperforms existing methods in both generalization and accuracy. Code is released on https://github.com/anpei96/hg-i2p-demo.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑