Non-iterative Coarse-to-fine Transformer Networks for Joint Affine and Deformable Image Registration
School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Royal Prince Alfred Hospital(皇家阿尔弗雷德王子医院);Med-X Research Institute, Shanghai Jiao Tong University(上海交通大学Med-X研究院)
Mingyuan Meng, Lei Bi, Michael Fulham, Dagan Feng, Jinman Kim
备注:
Accepted at International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2023)
发表信息:
International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), pp.750-760, 2023
Image registration is a fundamental requirement for medical image analysis. Deep registration methods based on deep learning have been widely recognized for their capabilities to perform fast end-to-end registration. Many deep registration methods achieved state-of-the-art performance by performing coarse-to-fine registration, where multiple registration steps were iterated with cascaded networks. Recently, Non-Iterative Coarse-to-finE (NICE) registration methods have been proposed to perform coarse-to-fine registration in a single network and showed advantages in both registration accuracy and runtime. However, existing NICE registration methods mainly focus on deformable registration, while affine registration, a common prerequisite, is still reliant on time-consuming traditional optimization-based methods or extra affine registration networks. In addition, existing NICE registration methods are limited by the intrinsic locality of convolution operations. Transformers may address this limitation for their capabilities to capture long-range dependency, but the benefits of using transformers for NICE registration have not been explored. In this study, we propose a Non-Iterative Coarse-to-finE Transformer network (NICE-Trans) for image registration. Our NICE-Trans is the first deep registration method that (i) performs joint affine and deformable coarse-to-fine registration within a single network, and (ii) embeds transformers into a NICE registration framework to model long-range relevance between images. Extensive experiments with seven public datasets show that our NICE-Trans outperforms state-of-the-art registration methods on both registration accuracy and runtime.
3D deformable registration of longitudinal abdominopelvic CT images using unsupervised deep learning
University of Cambridge(剑桥大学);Cancer Research UK Cambridge Centre(英国癌症研究中心剑桥中心);Medical University Vienna(维也纳医科大学);Cambridge University Hospitals National Health Service (NHS) Foundation Trust(剑桥大学医院国民保健服务基金会信托);Eindhoven University of Technology(埃因霍温理工大学);Leiden University(莱顿大学);University College London(伦敦大学学院);Cancer Research UK Cambridge Institute(英国癌症研究中心剑桥研究所)
AutoFuse: Automatic Fusion Networks for Deformable Medical Image Registration
School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Royal Prince Alfred Hospital(皇家阿尔弗雷德王子医院)
Unsupervised Deformable Image Registration with Local-Global Attention and Image Decomposition
Institute of Medical Technology, Peking University Health Science Center(北京大学医学部医学技术研究所);National Institute of Health Data Science, Peking University(北京大学国家健康数据科学研究院);Department of Radiology, Peking University Third Hospital(北京大学第三医院放射科);Department of Pediatrics, Peking University First Hospital(北京大学第一医院儿科);Pediatric Epilepsy Center, Peking University First Hospital(北京大学第一医院儿童癫痫中心);School of Biological Science and Medical Engineering, Southeast University(东南大学生物科学与医学工程学院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
A Transformer-based Network for Deformable Medical Image Registration
Huazhong University of Science and Technology(华中科技大学);College of Life Science and Technology, Huazhong University of Science and Technology(华中科技大学生命科学与技术学院)
A coarse-to-fine framework for unsupervised multi-contrast MR image deformable registration with dual consistency constraint
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心);Pengcheng Laboratory(鹏城实验室);Pazhou Lab(琶洲实验室);Guizhou Provincial People’s Hospital(贵州省人民医院)
A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration
Image Sciences Institute, University Medical Center Utrecht and Utrecht University(乌得勒支大学医学中心与乌得勒支大学影像科学研究所);Division of Image Processing of the Leiden University Medical Center(莱顿大学医学中心图像处理部)
Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image Registration
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
Image Sciences Institute, University Medical Center Utrecht(乌得勒支大学医学中心图像科学研究所);Division of Image Processing, Leiden University Medical Center(莱顿大学医学中心图像处理部)
Linear and Deformable Image Registration with 3D Convolutional Neural Networks
University of Bern(伯尔尼大学);CentraleSupélec(中央理工-高等电力学院);Université Paris-Saclay(巴黎-萨克雷大学);Groupe Hospitalier Cochin-Hôtel Dieu(科钦-主宫医院集团);Université Paris Descartes(巴黎笛卡尔大学);TheraPanacea
2D-3D Deformable Image Registration of Histology Slide and Micro-CT with ML-based Initialization
ImFusion GmbH(ImFusion有限公司);Technical University of Munich(慕尼黑工业大学);Institute of Pathology, Heinrich Heine University and University Hospital of Düsseldorf(海因里希·海涅大学与杜塞尔多夫大学医院病理研究所);Fraunhofer Institute for High-Speed Dynamics, Ernst-Mach-Institut(弗劳恩霍夫高速动力学研究所(恩斯特·马赫研究所))
Korea Advanced Institute of Science and Technology(韩国科学技术院);The Catholic University of Korea(韩国加图立大学);University of Ulsan College of Medicine(蔚山大学医学院);Asan Medical Center(峨山医疗中心);Korea Automotive Technology Institute(韩国汽车技术研究院)
Surrogate Supervision for Robust and Generalizable Deformable Image Registration
Department of Electrical and Computer Engineering, Vanderbilt University(维斯尼尔大学电气与计算机工程系);Department of Radiology and Radiological Science, Johns Hopkins Medical School(约翰霍普金斯医学学校放射学与放射科学系);Image Analysis and Communications Laboratory in the Department of Electrical and Computer Engineering, Johns Hopkins University(约翰霍普金斯大学电气与计算机工程系图像分析与通信实验室);Center for Cognitive Medicine, Department of Psychiatry and Behavioral Science, Vanderbilt University Medical Center(维斯尼尔大学医学中心认知医学中心);University of Pittsburgh, School of Medicine(匹兹堡大学医学院)
A Hybrid Deep Feature-Based Deformable Image Registration Method for Pathology Images
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);School of Mathematics, Sun Yat-sen University(中山大学数学学院);Stanford University(斯坦福大学);Guangdong Medical University(广东医科大学);Xiaohe Healthcare ByteDance(字节跳动小河医疗)
Domain-Shift Immunity in Deep Deformable Registration via Local Feature Representations
Kahlert School of Computing(卡尔伯特计算学校);Scientific Computing and Imaging Institute(科学计算与成像研究所);University of Utah(犹他大学);Department of Biomedical Engineering(生物医学工程系)
Multimodal Deformable Image Registration for Long-COVID Analysis Based on Progressive Alignment and Multi-perspective Loss
University of Oxford(牛津大学);Nuffield Department of Population Health, University of Oxford(牛津大学纳菲尔德人口健康系);Big Data Institute, University of Oxford(牛津大学大数据研究所);Oxford University Hospitals NHS Foundation Trust(牛津大学医院 NHS 基金会信托基金);Oxford Radiology Research Unit(牛津放射学研究单元)
Deformable image registration with deep network priors: a study on longitudinal PET images
Ecole Centrale de Nantes(南特中央理工学院);Keosys Medical Imaging(Keosys医学影像公司);University of Nantes(南特大学);University of Angers(昂热大学);ICO Cancer Center(ICO癌症中心)
Robust deformable image registration using cycle-consistent implicit representations
Amsterdam UMC location University of Amsterdam(阿姆斯特丹大学医学中心(阿姆斯特丹大学));Informatics Institute, University of Amsterdam(阿姆斯特丹大学信息学研究所);Amsterdam Gastroenterology Endocrinology Metabolism(阿姆斯特丹胃肠病学与内分泌代谢研究所);Cancer Center Amsterdam(阿姆斯特丹癌症中心)
Learning a Model-Driven Variational Network for Deformable Image Registration
University of Birmingham(伯明翰大学);Alan Turing Institute(阿兰·图灵研究所);Shenzhen University(深圳大学);Imperial College London(伦敦帝国学院);MRC London Institute of Medical Sciences(英国医学研究理事会伦敦医学科学研究所)
Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis
Radboudumc(拉德堡德大学医学中心);Fraunhofer MEVIS(弗劳恩霍夫梅维斯研究所);Universität zu Lübeck(吕贝克大学);University Medical Center Groningen(格罗宁根大学医学中心);Netherlands Cancer Institute(荷兰癌症研究所);Norwegian University of Science and Technology(挪威科技大学)