arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.10879cs.CV

一次配准抵得上两次分割

One registration is worth two segmentations

University College London(伦敦大学学院);Beijing Institute of Technology(北京理工大学)

Shiqi Huang, Tingfa Xu, Ziyi Shen, Shaheer Ullah Saeed, Wen Yan, Dean Barratt, Yipeng Hu

AI总结:

本文将图像配准重构为两幅图像上的对应 ROI 多类别分割,并提出无需训练数据或提示的 SAMReg,在多类临床影像上优于传统和学习式配准方法。

摘要:

图像配准的目标是在两幅或更多图像之间建立空间对应关系,传统上通过稠密位移场(DDF)或参数化变换(例如刚性、仿射和样条变换)实现。重新思考现有通过空间变换获得对齐的范式后,我们发现了一种替代且更直观的对应表示:一组相互对应的感兴趣区域(ROI)对;我们证明,该表示具有与其他对应表示方法同等充分的表示能力。此外,这些 ROI 既没有必要也不足以承载特定的解剖学或语义意义。据此,我们将图像配准表述为从浮动图像和固定图像中搜索同一组相互对应的 ROI——换言之,就是在一对图像上执行两个多类别分割任务。为了实现通用且实用的方案,我们将 segment anything model(SAM)集成到所提出的算法中,形成了支持 SAM 的配准方法 SAMReg,该方法不需要任何训练数据、基于梯度的微调或人工设计的提示。实验表明,所提出的 SAMReg 能够在前列腺 MR、心脏 MR 和腹部 CT 图像配准这三项临床应用中分割并匹配多个 ROI 对,从而建立足够准确的对应关系。基于解剖结构上的 Dice 和目标配准误差等指标,所提出的配准方法优于基于强度的迭代算法和预测 DDF 的基于学习的网络,甚至可与需要完全分割训练数据的弱监督配准取得具有竞争力的性能。

英文摘要:

The goal of image registration is to establish spatial correspondence between two or more images, traditionally through dense displacement fields (DDFs) or parametric transformations (e.g., rigid, affine, and splines). Rethinking the existing paradigms of achieving alignment via spatial transformations, we uncover an alternative but more intuitive correspondence representation: a set of corresponding regions-of-interest (ROI) pairs, which we demonstrate to have sufficient representational capability as other correspondence representation methods.Further, it is neither necessary nor sufficient for these ROIs to hold specific anatomical or semantic significance. In turn, we formulate image registration as searching for the same set of corresponding ROIs from both moving and fixed images - in other words, two multi-class segmentation tasks on a pair of images. For a general-purpose and practical implementation, we integrate the segment anything model (SAM) into our proposed algorithms, resulting in a SAM-enabled registration (SAMReg) that does not require any training data, gradient-based fine-tuning or engineered prompts. We experimentally show that the proposed SAMReg is capable of segmenting and matching multiple ROI pairs, which establish sufficiently accurate correspondences, in three clinical applications of registering prostate MR, cardiac MR and abdominal CT images. Based on metrics including Dice and target registration errors on anatomical structures, the proposed registration outperforms both intensity-based iterative algorithms and DDF-predicting learning-based networks, even yielding competitive performance with weakly-supervised registration which requires fully-segmented training data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑