Cardiac T1 mapping can evaluate various clinical symptoms of myocardial tissue. However, there is currently a lack of effective, robust, and efficient methods for motion correction in cardiac T1 mapping. In this paper, we propose a deep learning-based and topology-preserving image registration framework for motion correction in cardiac T1 mapping. Notably, our proposed implicit consistency constraint dubbed BLOC, to some extent preserves the image topology in registration by bidirectional consistency constraint and local anti-folding constraint. To address the contrast variation issue, we introduce a weighted image similarity metric for multimodal registration of cardiac T1-weighted images. Besides, a semi-supervised myocardium segmentation network and a dual-domain attention module are integrated into the framework to further improve the performance of the registration. Numerous comparative experiments, as well as ablation studies, demonstrated the effectiveness and high robustness of our method. The results also indicate that the proposed weighted image similarity metric, specifically crafted for our network, contributes a lot to the enhancement of the motion correction efficacy, while the bidirectional consistency constraint combined with the local anti-folding constraint ensures a more desirable topology-preserving registration mapping.
University of Edinburgh（爱丁堡大学）；Imperial College London（帝国理工学院）；University of Essex（埃塞克斯大学）
Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the imaging content across modalities. Inter- and intra-modality affine and non-rigid image registration is an essential medical image analysis process in clinical imaging, as for example before imaging biomarkers need to be derived and clinically evaluated across different MRI modalities, time phases and slices. Although commonly needed in real clinical scenarios, …
Fraunhofer MEVIS（弗劳恩霍夫医学图像计算研究所）；Radboud UMC（拉德堡德大学医学中心）；University of Lübeck（吕贝克大学）
While deep learning has achieved significant advances in accuracy for medical image segmentation, its benefits for deformable image registration have so far remained limited to reduced computation times. Previous work has either focused on replacing the iterative optimization of distance and smoothness terms with CNN-layers or using supervised approaches driven by labels. Our method is the first to combine the complementary strengths of global semantic information (represented by segmentation labels) and local distance metrics that help align surrounding structures. We demonstrate significant …
This study proposes an end-to-end unsupervised diffeomorphic deformable registration framework based on moving mesh parameterization. Using this parameterization, a deformation field can be modeled with its transformation Jacobian determinant and curl of end velocity field. The new model of the deformation field has three important advantages; firstly, it relaxes the need for an explicit regularization term and the corresponding weight in the cost function. The smoothness is implicitly embedded in the solution which results in a physically plausible deformation field. Secondly, it guarantees d…
Deformable Image Registration for Self-supervised Cardiac Phase Detection in Multi-View Multi-Disease Cardiac Magnetic Resonance Images
Department of Internal Medicine III, Heidelberg University Hospital（海德堡大学第三内科部门医院）；Medical Faculty of Heidelberg University（海德堡大学医学院）；DZHK (German Centre for Cardiovascular Research)（德国心血管研究中心）；Division of Pediatric Cardiology, Department of Pediatrics, UT Southwestern /Children’s Health（儿童心脏病科，德克萨斯西南医学中心/儿童健康）；Department of Cardiothoracic, Transplantation and Vascular Surgery, Hannover Medical School（汉诺威医学院心胸外科、移植外科和血管外科部门）
本文提出一种自监督深度学习方法，通过多视角多疾病心脏磁共振图像检测五个关键帧，提高了心脏相位检测的准确率，适用于SAX和4CH cine CMR。
Point cloud-based registration and image fusion between cardiac SPECT MPI and CTA
Xi’an University of Posts and Telecommunications（西安邮电大学）；Nanjing Medical University（南京医科大学）；The First Affiliated Hospital of Nanjing Medical University（南京医科大学第一附属医院）；The First Affiliated Hospital of Xi’an Jiaotong University（西安交通大学第一附属医院）；Kennesaw State University（肯尼索州立大学）；Michigan Technological University（密歇根理工大学）
Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, United States Berlin Ultrahigh Field Facility (B.U.F.F.), Max Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Germany Department of Imaging Physics, Delft University of Technology, Netherlands TUM School of Computation, Information；Technology, Technische Universität München, Germany Department of Surgery, Taipei Veterans General Hospital, Taiwan
Multiparametric mapping MRI has become a viable tool for myocardial tissue characterization. However, misalignment between multiparametric maps makes pixel-wise analysis challenging. To address this challenge, we developed a generalizable physics-informed deep-learning model using test-time adaptation to enable group image registration across contrast weighted images acquired from multiple physical models (e.g., a T1 mapping model and T2 mapping model). The physics-informed adaptation utilized the synthetic images from specific physics model as registration reference, allows for transductive l…
Image registration aims to establish spatial correspondence across pairs, or groups of images, and is a cornerstone of medical image computing and computer-assisted-interventions. Currently, most deep learning-based registration methods assume that the desired deformation fields are globally smooth and continuous, which is not always valid for real-world scenarios, especially in medical image registration (e.g. cardiac imaging and abdominal imaging). Such a global constraint can lead to artefacts and increased errors at discontinuous tissue interfaces. To tackle this issue, we propose a weakly…
Image Sciences Institute, University Medical Center Utrecht（乌得勒支大学医学中心图像科学研究所）；Division of Image Processing, Leiden University Medical Center（莱顿大学医学中心图像处理部）
In this work we propose a deep learning network for deformable image registration (DIRNet). The DIRNet consists of a convolutional neural network (ConvNet) regressor, a spatial transformer, and a resampler. The ConvNet analyzes a pair of fixed and moving images and outputs parameters for the spatial transformer, which generates the displacement vector field that enables the resampler to warp the moving image to the fixed image. The DIRNet is trained end-to-end by unsupervised optimization of a similarity metric between input image pairs. A trained DIRNet can be applied to perform registration …
University of Kansas（堪萨斯大学）；Rochester Institute of Technology（罗切斯特理工学院）
Patient-specific left ventricle (LV) myocardial models have the potential to be used in a variety of clinical scenarios for improved diagnosis and treatment plans. Cine cardiac magnetic resonance (MR) imaging provides high resolution images to reconstruct patient-specific geometric models of the LV myocardium. With the advent of deep learning, accurate segmentation of cardiac chambers from cine cardiac MR images and unsupervised learning for image registration for cardiac motion estimation on a large number of image datasets is attainable. Here, we propose a deep leaning-based framework for th…
multimodars: A Rust-powered toolkit for multi-modality cardiac image fusion and registration
Department of Cardiology, Inselspital, Bern University Hospital, University of Bern（伯尔尼大学伯尔尼大学医院 Inselspital 心脏病学系）；Graduate School for Cellular and Biomedical Sciences, University of Bern（伯尔尼大学细胞与生物医学科学研究生院）
WarpPINN: Cine-MR image registration with physics-informed neural networks
University of Bath（巴斯大学）；Pontificia Universidad Católica de Valparaíso（瓦尔帕莱索天主大学）；Millennium Institute for Intelligent Healthcare Engineering（千年智能医疗工程研究所）；Pontificia Universidad Católica de Chile（智利天主大学）
In nuclear imaging, limited resolution causes partial volume effects (PVEs) that affect image sharpness and quantitative accuracy. Partial volume correction (PVC) methods incorporating high-resolution anatomical information from CT or MRI have been demonstrated to be effective. However, such anatomical-guided methods typically require tedious image registration and segmentation steps. Accurately segmented organ templates are also hard to obtain, particularly in cardiac SPECT imaging, due to the lack of hybrid SPECT/CT scanners with high-end CT and associated motion artifacts. Slight mis-regist…
Image registration is a fundamental building block for various applications in medical image analysis. To better explore the correlation between the fixed and moving images and improve registration performance, we propose a novel deep learning network, Co-Attention guided Registration Network (CAR-Net). CAR-Net employs a co-attention block to learn a new representation of the inputs, which drives the registration of the fixed and moving images. Experiments on UK Biobank cardiac cine-magnetic resonance image data demonstrate that CAR-Net obtains higher registration accuracy and smoother deforma…
TLRN: Temporal Latent Residual Networks For Large Deformation Image Registration
Department of Electrical and Computer Engineering, University of Virginia, USA（电气与计算机工程系，弗吉尼亚大学）；Department of Computer Science, University of Virginia, USA（计算机科学系，弗吉尼亚大学）
Imperial College London（帝国理工学院）；Technical University of Munich（慕尼黑工业大学）；University of Edinburgh（爱丁堡大学）
Deep learning (DL) image registration methods amortize the costly pair-wise iterative optimization by training deep neural networks to predict the optimal transformation in one fast forward-pass. In this work, we bridge the gap between traditional iterative energy optimization-based registration and network-based registration, and propose Gradient Descent Network for Image Registration (GraDIRN). Our proposed approach trains a DL network that embeds unrolled multiresolution gradient-based energy optimization in its forward pass, which explicitly enforces image dissimilarity minimization in its…
Attention-aware non-rigid image registration for accelerated MR imaging
University Hospital of Tuebingen（蒂宾根大学医院）；Klinikum Rechts der Isar（右岸医院（慕尼黑工业大学附属））；Technical University of Munich（慕尼黑工业大学）；School of Computation, Information and Technology, Technical University of Munich（慕尼黑工业大学计算、信息与技术学院）；Imperial College London（伦敦帝国学院）
Image Sciences Institute, University Medical Center Utrecht and Utrecht University（乌得勒支大学医学中心与乌得勒支大学影像科学研究所）；Division of Image Processing of the Leiden University Medical Center（莱顿大学医学中心图像处理部）
Image registration, the process of aligning two or more images, is the core technique of many (semi-)automatic medical image analysis tasks. Recent studies have shown that deep learning methods, notably convolutional neural networks (ConvNets), can be used for image registration. Thus far training of ConvNets for registration was supervised using predefined example registrations. However, obtaining example registrations is not trivial. To circumvent the need for predefined examples, and thereby to increase convenience of training ConvNets for image registration, we propose the Deep Learning Im…
Uppsala University（乌普萨拉大学）；Elekta Instrument AB（医科达仪器有限公司）
Our anatomy is in constant motion. With modern MR imaging it is possible to record this motion in real-time during an ongoing radiation therapy session. In this paper we present an image registration method that exploits the sequential nature of 2D MR images to estimate the corresponding displacement field. The method employs several discriminative correlation filters that independently track specific points. Together with a sparse-to-dense interpolation scheme we can then estimate of the displacement field. The discriminative correlation filters are trained online, and our method is modality …
Current deep-learning-based registration algorithms often exploit intensity-based similarity measures as the loss function, where dense correspondence between a pair of moving and fixed images is optimized through backpropagation during training. However, intensity-based metrics can be misleading when the assumption of intensity class correspondence is violated, especially in cross-modality or contrast-enhanced images. Moreover, existing learning-based registration methods are predominantly applicable to pairwise registration and are rarely extended to groupwise registration or simultaneous re…
Heidelberg University Hospital（海德堡大学医院）；DZHK (German Centre for Cardiovascular Research)（德国心血管研究中心）；UT Southwestern Medical Center（德克萨斯大学西南医学中心）；German Competence Network for Congenital Heart Defects（德国先天性心脏病能力网络）；Hannover Medical School（汉诺威医学院）
Cardiac magnetic resonance (CMR) sequences visualise the cardiac function voxel-wise over time. Simultaneously, deep learning-based deformable image registration is able to estimate discrete vector fields which warp one time step of a CMR sequence to the following in a self-supervised manner. However, despite the rich source of information included in these 3D+t vector fields, a standardised interpretation is challenging and the clinical applications remain limited so far. In this work, we show how to efficiently use a deformable vector field to describe the underlying dynamic process of a car…
Faculty of Electrical & Computer Engineering, Technion - IIT（以色列理工学院电气与计算机工程学院）；Faculty of Biomedical Engineering, Technion - IIT（以色列理工学院生物医学工程学院）；The May-Blum-Dahl MRI Research Center, Faculty of Biomedical Engineering, Technion - IIT（以色列理工学院生物医学工程学院梅-布-达尔磁共振成像研究中心）；Bnai Zion Medical Center（巴奈锡安医疗中心）
Benchmarking Self-Supervised Models for Cardiac Ultrasound View Classification
Department of Systems；Computer Engineering, Carleton University, Ottawa, Ontario, Canada Department of Methodological；Implementation Research, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada Department of Acute Care Research, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada Department of Obstetrics；Gynecology, University of Ottawa, Ottawa, Ontario, Canada School of Epidemiology；Public Health, University of Ottawa, Ottawa, Ontario, Canada Department of Obstetrics, Gynecology \& Newborn Care, The Ottawa Hospital, Ottawa, Ontario, Canada International；Global Health Office, University of Ottawa, Ottawa, Ontario, Canada College of Medicine, Alfaisal University, Riyadh, Saudi Arabia
CMRINet: Joint Groupwise Registration and Segmentation for Cardiac Function Quantification from Cine-MRI
Leiden University Medical Center（莱顿大学医学中心）；University of Sheffield（谢菲尔德大学）；INSIGNEO；Institute for In Silico Medicine（计算医学研究所）；Department of Infection, Immunity and Cardiovascular Disease（感染、免疫与心血管疾病部门）；Sheffield Teaching Hospitals（谢菲尔德教学医院）；Department of Clinical Radiology（临床放射学部门）
University of Alberta（阿尔伯塔大学）；Servier Virtual Cardiac Centre（施维雅虚拟心脏中心）；Mazankowski Alberta Heart Institute（马赞科夫斯基阿尔伯塔心脏研究所）
Diffeomorphic deformable image registration is one of the crucial tasks in medical image analysis, which aims to find a unique transformation while preserving the topology and invertibility of the transformation. Deep convolutional neural networks (CNNs) have yielded well-suited approaches for image registration by learning the transformation priors from a large dataset. The improvement in the performance of these methods is related to their ability to learn information from several sample medical images that are difficult to obtain and bias the framework to the specific domain of data. In thi…
PSIRNet: Deep Learning-based Free-breathing Rapid Acquisition Late Enhancement Imaging
Health Futures, Microsoft Research（微软研究院健康未来）；Center for Data Science, New York University（纽约大学数据科学中心）；Center for Advanced Imaging Innovation and Research (CAI2R), Department of Radiology, NYU Grossman School of Medicine（纽约大学格罗斯曼医学院放射学系高级成像创新与研究中心）；Bernard and Irene Schwartz Center for Biomedical Imaging, Department of Radiology, NYU Grossman School of Medicine（纽约大学格罗斯曼医学院放射学系伯纳德和艾琳·施瓦茨生物医学成像中心）；Institute of Cardiovascular Science, University College London（伦敦大学学院心血管科学研究所）；Barts Heart Centre, Barts Health NHS Trust（巴茨健康NHS信托巴茨心脏中心）
Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration
School of Data Science, Fudan University（复旦大学数据科学学院）；Department of Electrical and Electronic Engineering and I-X, Imperial College London（帝国理工学院电子与电气工程系）；Department of Electrical and Computer Engineering, University of Washington（华盛顿大学电气与计算机工程系）；Paul G. Allen School of Computer Science and Engineering, University of Washington（华盛顿大学保罗·G·艾伦计算机科学与工程学院）；Department of Radiology and Imaging Sciences, University of Utah（犹他大学放射科与成像科学系）；Department of Radiology, University of Washington（华盛顿大学放射科）；Institute of Science and Technology for Brain-Inspired Intellengence, Fudan University（复旦大学脑启发智能科学技术研究院）
Deep learning models for semantic segmentation are able to learn powerful representations for pixel-wise predictions, but are sensitive to noise at test time and do not guarantee a plausible topology. Image registration models on the other hand are able to warp known topologies to target images as a means of segmentation, but typically require large amounts of training data, and have not widely been benchmarked against pixel-wise segmentation models. We propose Atlas-ISTN, a framework that jointly learns segmentation and registration on 2D and 3D image data, and constructs a population-derived…
We propose to learn a probabilistic motion model from a sequence of images for spatio-temporal registration. Our model encodes motion in a low-dimensional probabilistic space - the motion matrix - which enables various motion analysis tasks such as simulation and interpolation of realistic motion patterns allowing for faster data acquisition and data augmentation. More precisely, the motion matrix allows to transport the recovered motion from one subject to another simulating for example a pathological motion in a healthy subject without the need for inter-subject registration. The method is b…
Single-photon emission computed tomography (SPECT) is a widely applied imaging approach for diagnosis of coronary artery diseases. Attenuation maps (u-maps) derived from computed tomography (CT) are utilized for attenuation correction (AC) to improve diagnostic accuracy of cardiac SPECT. However, SPECT and CT are obtained sequentially in clinical practice, which potentially induces misregistration between the two scans. Convolutional neural networks (CNN) are powerful tools for medical image registration. Previous CNN-based methods for cross-modality registration either directly concatenated t…
Learning a Model-Driven Variational Network for Deformable Image Registration
University of Birmingham（伯明翰大学）；Alan Turing Institute（阿兰·图灵研究所）；Shenzhen University（深圳大学）；Imperial College London（伦敦帝国学院）；MRC London Institute of Medical Sciences（英国医学研究理事会伦敦医学科学研究所）
Disentangling Progress in Medical Image Registration: Beyond Trend-Driven Architectures towards Domain-Specific Strategies
Technical University of Munich（慕尼黑技术大学）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）；Imperial College London（伦敦帝国理工学院）；University of Pennsylvania（宾夕法尼亚大学）；National University of Singapore（新加坡国立大学）
School of Computer Science, University of Birmingham（伯明翰大学计算机学院）；Institute of Cardiovascular Sciences, University of Birmingham（伯明翰大学心血管科学研究所）；MRC London Institute of Medical Sciences, Imperial College London（帝国理工学院伦敦医学研究委员会医学科学研究所）；Institute of Cancer and Genomic Sciences, University of Birmingham（伯明翰大学癌症与基因组科学研究所）
Deterministic approaches using iterative optimisation have been historically successful in diffeomorphic image registration (DiffIR). Although these approaches are highly accurate, they typically carry a significant computational burden. Recent developments in stochastic approaches based on deep learning have achieved sub-second runtimes for DiffIR with competitive registration accuracy, offering a fast alternative to conventional iterative methods. In this paper, we attempt to reduce this difference in speed whilst retaining the performance advantage of iterative approaches in DiffIR. We firs…
The Chinese University of Hong Kong（香港中文大学）；The Hong Kong Polytechnic University（香港理工大学）；Shenzhen Institute of Advanced Technology, CAS（中国科学院深圳先进技术研究院）；National University of Singapore（新加坡国立大学）
University of Leeds（利兹大学）；Leeds Institute for Cardiovascular and Metabolic Medicine（利兹心血管与代谢医学研究所）；KU Leuven（荷语鲁汶大学）；Alan Turing Institute（艾伦·图灵研究所）
Medical image registration is a challenging task involving the estimation of spatial transformations to establish anatomical correspondence between pairs or groups of images. Recently, deep learning-based image registration methods have been widely explored, and demonstrated to enable fast and accurate image registration in a variety of applications. However, most deep learning-based registration methods assume that the deformation fields are smooth and continuous everywhere in the image domain, which is not always true, especially when registering images whose fields of view contain discontin…
Imperial College London（帝国理工学院）；University of Edinburgh（爱丁堡大学）
Image registration is an ill-posed inverse problem which often requires regularisation on the solution space. In contrast to most of the current approaches which impose explicit regularisation terms such as smoothness, in this paper we propose a novel method that can implicitly learn biomechanics-informed regularisation. Such an approach can incorporate application-specific prior knowledge into deep learning based registration. Particularly, the proposed biomechanics-informed regularisation leverages a variational autoencoder (VAE) to learn a manifold for biomechanically plausible deformations…
Université de Sherbrooke（舍布鲁克大学）；Xiamen University（厦门大学）；Centre Antoine Lacassagne（安托万·拉卡萨涅中心）；Université de Bourgogne Franche-Comté（勃艮第-弗朗什-孔泰大学）
In this paper, we propose a fully automatic MRI cardiac segmentation method based on a novel deep convolutional neural network (CNN) designed for the 2017 ACDC MICCAI challenge. The novelty of our network comes with its embedded shape prior and its loss function tailored to the cardiac anatomy. Our model includes a cardiac centerof-mass regression module which allows for an automatic shape prior registration. Also, since our method processes raw MR images without any manual preprocessing and/or image cropping, our CNN learns both high-level features (useful to distinguish the heart from other …
GSMorph: Gradient Surgery for cine-MRI Cardiac Deformable Registration
University of Leeds（利兹大学）；Radboud University Medical Centre（拉德堡德大学医学中心）；Netherlands Cancer Institute（荷兰癌症研究所）；Shenzhen University（深圳大学）；Shenzhen RayShape Medical Technology Co., Ltd（深圳睿心医疗科技有限公司）
NVIDIA（英伟达）；Lenovo Research（联想研究院）；Piedmont Heart Institute（皮埃蒙特心脏研究所）；Tencent Medical AI Lab（腾讯医疗人工智能实验室）；University of California, Irvine（加州大学欧文分校）
Echocardiography has become routinely used in the diagnosis of cardiomyopathy and abnormal cardiac blood flow. However, manually measuring myocardial motion and cardiac blood flow from echocardiogram is time-consuming and error-prone. Computer algorithms that can automatically track and quantify myocardial motion and cardiac blood flow are highly sought after, but have not been very successful due to noise and high variability of echocardiography. In this work, we propose a neural multi-scale self-supervised registration (NMSR) method for automated myocardial and cardiac blood flow dense track…
