arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.06288cs.CV

无监督的MR-US多模态图像配准与多级相关金字塔优化

Unsupervised MR-US Multimodal Image Registration with Multilevel Correlation Pyramidal Optimization

School of Artificial Intelligence and Robotics, Hunan University, Changsha, Hunan, China(人工智能与机器人学院,湖南大学,长沙,湖南,中国);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, Changsha, Hunan, China(机器人视觉感知与控制技术国家工程研究中心,湖南大学,长沙,湖南,中国);National University of Singapore(新加坡国立大学);Cornell University(康奈尔大学)

Jiazheng Wang, Zeyu Liu, Min Liu, Xiang Chen, Xinyao Yu, Yaonan Wang, Hang Zhang

AI总结:

本研究提出基于多级相关金字塔优化的无监督多模态图像配准方法,以解决术前与术中多模态图像的配准问题,实现了在ReMIND2Reg任务中的优异表现。

摘要:

基于多模态图像配准的手术导航在提供术中指导方面发挥了重要作用,通过在手术过程中显示目标区域相对于关键解剖结构的相对位置。然而,由于多模态图像之间的差异以及术中图像因组织位移和移除而产生的形变,预手术和术中多模态图像的有效配准面临重大挑战。为了解决Learn2Reg 2025中的多模态图像配准挑战,设计了一种基于多级相关金字塔优化(MCPO)的无监督多模态医学图像配准方法,以解决这些问题。首先,基于模态独立邻域描述符提取每种模态的特征,并将多模态图像映射到特征空间。其次,设计了一种多级金字塔融合优化机制,通过密集相关分析和加权平衡的耦合凸优化,对不同尺度的输入特征实现位移场的全局优化和局部细节补充。我们的方法专注于Learn2Reg 2025中的ReMIND2Reg任务。基于结果,我们的方法在ReMIND2Reg的验证阶段和测试阶段均取得了第一名。MCPO还在Resect数据集上进行了验证,实现了平均TRE为1.798毫米。这证明了我们的方法在预手术到术中图像配准中的广泛应用性。代码可在https://github.com/wjiazheng/MCPO获取。

英文摘要:

Surgical navigation based on multimodal image registration has played a significant role in providing intraoperative guidance to surgeons by showing the relative position of the target area to critical anatomical structures during surgery. However, due to the differences between multimodal images and intraoperative image deformation caused by tissue displacement and removal during the surgery, effective registration of preoperative and intraoperative multimodal images faces significant challenges. To address the multimodal image registration challenges in Learn2Reg 2025, an unsupervised multimodal medical image registration method based on Multilevel Correlation Pyramidal Optimization (MCPO) is designed to solve these problems. First, the features of each modality are extracted based on the modality independent neighborhood descriptor, and the multimodal images is mapped to the feature space. Second, a multilevel pyramidal fusion optimization mechanism is designed to achieve global optimization and local detail complementation of the displacement field through dense correlation analysis and weight-balanced coupled convex optimization for input features at different scales. Our method focuses on the ReMIND2Reg task in Learn2Reg 2025. Based on the results, our method achieved the first place in the validation phase and test phase of ReMIND2Reg. The MCPO is also validated on the Resect dataset, achieving an average TRE of 1.798 mm. This demonstrates the broad applicability of our method in preoperative-to-intraoperative image registration. The code is available at https://github.com/wjiazheng/MCPO.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑