arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.03421cs.CVcs.AIeess.IV
收藏

用于联合仿射与可形变图像配准的非迭代由粗到精Transformer网络

Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration

School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Royal Prince Alfred Hospital(皇家阿尔弗雷德王子医院);Med-X Research Institute, Shanghai Jiao Tong University(上海交通大学Med-X研究院)

Mingyuan Meng, Lei Bi, Michael Fulham, Dagan Feng, Jinman Kim

AI总结:

针对现有非迭代由粗到精配准方法依赖额外仿射配准、受卷积局部性限制的问题,提出嵌入Transformer的NICE-Trans网络,实现单网络联合仿射与可形变配准,在7个公开数据集上精度与速度均超现有最优方法。

摘要:

图像配准是医学图像分析的一项基础需求。基于深度学习的深度配准方法凭借其快速端到端配准的能力已获得广泛认可。许多深度配准方法通过执行由粗到精的配准取得了当前最优性能,这类方法通过级联网络迭代执行多个配准步骤。近期,研究者提出了非迭代由粗到精(Non-Iterative Coarse-to-finE, NICE)配准方法,可在单个网络内完成由粗到精的配准,在配准精度和运行时间上均展现出优势。然而,现有NICE配准方法主要聚焦于可形变配准,而作为常见前置步骤的仿射配准仍依赖耗时的传统优化类方法,或是额外的仿射配准网络。此外,现有NICE配准方法受限于卷积操作固有的局部性。Transformer凭借其捕捉长程依赖的能力或可解决这一局限,但将Transformer用于NICE配准的增益尚未得到探究。本研究中,我们提出了一种用于图像配准的非迭代由粗到精Transformer网络(NICE-Trans)。我们的NICE-Trans是首个具备以下特性的深度配准方法:(1)在单个网络内执行联合仿射与可形变的由粗到精配准;(2)将Transformer嵌入NICE配准框架以建模图像间的长程关联。在七个公开数据集上开展的大量实验表明,我们的NICE-Trans在配准精度和运行时间上均优于现有最优配准方法。

英文摘要:

Image registration is a fundamental requirement for medical image analysis. Deep registration methods based on deep learning have been widely recognized for their capabilities to perform fast end-to-end registration. Many deep registration methods achieved state-of-the-art performance by performing coarse-to-fine registration, where multiple registration steps were iterated with cascaded networks. Recently, Non-Iterative Coarse-to-finE (NICE) registration methods have been proposed to perform coarse-to-fine registration in a single network and showed advantages in both registration accuracy and runtime. However, existing NICE registration methods mainly focus on deformable registration, while affine registration, a common prerequisite, is still reliant on time-consuming traditional optimization-based methods or extra affine registration networks. In addition, existing NICE registration methods are limited by the intrinsic locality of convolution operations. Transformers may address this limitation for their capabilities to capture long-range dependency, but the benefits of using transformers for NICE registration have not been explored. In this study, we propose a Non-Iterative Coarse-to-finE Transformer network (NICE-Trans) for image registration. Our NICE-Trans is the first deep registration method that (i) performs joint affine and deformable coarse-to-fine registration within a single network, and (ii) embeds transformers into a NICE registration framework to model long-range relevance between images. Extensive experiments with seven public datasets show that our NICE-Trans outperforms state-of-the-art registration methods on both registration accuracy and runtime.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑