In this work, we proposed a continuous-acquisition strategy using a gradient echo (GRE) inversion recovery sequence based on spiral trajectories to simultaneously obtain the $T_1$ mapping and CINE imaging. The acquisition is using a free-breathing and ungated fashion. An approach based on variational auto-encoder(VAE) is used for the motion estimation from the centered k-space data. The motion signal is then used to train a deep manifold reconstruction algorithm for image reconstruction. Once the network is trained, we can excite the latent vectors (the estimated motion signals and the contrast signal) in any way as we wanted to generate the image frames in the time series. We can estimate the $T_1$ mapping using the generated image frames where only contrast is varying. We can also generate the breath-hold CINE in different contrast.
National Heart and Lung Institute, Imperial College London（帝国理工学院国家心肺研究所）；Imperial College London（帝国理工学院）；Royal Brompton Hospital（皇家布朗普顿医院）
Temporal patterns of cardiac motion provide important information for cardiac disease diagnosis. This pattern could be obtained by three-directional CINE multi-slice left ventricular myocardial velocity mapping (3Dir MVM), which is a cardiac MR technique providing magnitude and phase information of the myocardial motion simultaneously. However, long acquisition time limits the usage of this technique by causing breathing artifacts, while shortening the time causes low temporal resolution and may provide an inaccurate assessment of cardiac motion. In this study, we proposed a frame synthesis al…
Imperial College London（帝国理工学院）；MRC London Institute of Medical Sciences（MRC伦敦医学科学研究所）
In this work, a novel approach is proposed for joint analysis of high dimensional time-resolved cardiac motion features obtained from segmented cardiac MRI and low dimensional clinical risk factors to improve survival prediction in heart failure. Different methods are evaluated to find the optimal way to insert conventional covariates into deep prediction networks. Correlation analysis between autoencoder latent codes and covariate features is used to examine how these predictors interact. We believe that similar approaches could also be used to introduce knowledge of genetic variants to such …
Rutgers University（罗格斯大学）；SenseBrain Research（SenseBrain研究院）；University of Arkansas for Medical Sciences（阿肯色大学医学院）；Lund University（隆德大学）；New York University（纽约大学）
Joint 2D cardiac segmentation and 3D volume reconstruction are fundamental to building statistical cardiac anatomy models and understanding functional mechanisms from motion patterns. However, due to the low through-plane resolution of cine MR and high inter-subject variance, accurately segmenting cardiac images and reconstructing the 3D volume are challenging. In this study, we propose an end-to-end latent-space-based framework, DeepRecon, that generates multiple clinically essential outcomes, including accurate image segmentation, synthetic high-resolution 3D image, and 3D reconstructed volu…
Fudan University（复旦大学）；Imperial College London（帝国理工学院）；University of Edinburgh（爱丁堡大学）；MRC London Institute of Medical Sciences（英国医学研究委员会伦敦医学科学研究所）；National Heart Research Institute, Singapore（新加坡国家心脏研究所）
In cardiac magnetic resonance (CMR) imaging, a 3D high-resolution segmentation of the heart is essential for detailed description of its anatomical structures. However, due to the limit of acquisition duration and respiratory/cardiac motion, stacks of multi-slice 2D images are acquired in clinical routine. The segmentation of these images provides a low-resolution representation of cardiac anatomy, which may contain artefacts caused by motion. Here we propose a novel latent optimisation framework that jointly performs motion correction and super resolution for cardiac image segmentations. Give…
Cardiovascular Research Institute, University of California, San Francisco（加州大学旧金山分校心血管研究所）；Yale School of Medicine, Yale University（耶鲁大学耶鲁医学院）；School of Physics, Georgia Institute of Technology（佐治亚理工学院物理学院）
The analysis of electrical impulse phenomena in cardiac muscle tissue is important for the diagnosis of heart rhythm disorders and other cardiac pathophysiology. Cardiac mapping techniques acquire local temporal measurements and combine them to visualize the spread of electrophysiological wave phenomena across the heart surface. However, low spatial resolution, sparse measurement locations, noise and other artifacts make it challenging to accurately visualize spatio-temporal activity. For instance, electro-anatomical catheter mapping is severely limited by the sparsity of the measurements, and…
Faculty of Electrical & Computer Engineering, Technion - IIT（以色列理工学院电气与计算机工程学院）；Faculty of Biomedical Engineering, Technion - IIT（以色列理工学院生物医学工程学院）；The May-Blum-Dahl MRI Research Center, Faculty of Biomedical Engineering, Technion - IIT（以色列理工学院生物医学工程学院梅-布-达尔磁共振成像研究中心）；Bnai Zion Medical Center（巴奈锡安医疗中心）
National Heart & Lung Institute, Imperial College London（伦敦帝国理工学院国家心肺研究所）；Royal Brompton Hospital（皇家布朗普顿医院）
Four-dimensional (4D) left ventricular myocardial velocity mapping (MVM) is a cardiac magnetic resonance (CMR) technique that allows assessment of cardiac motion in three orthogonal directions. Accurate and reproducible delineation of the myocardium is crucial for accurate analysis of peak systolic and diastolic myocardial velocities. In addition to the conventionally available magnitude CMR data, 4D MVM also acquires three velocity-encoded phase datasets which are used to generate velocity maps. These can be used to facilitate and improve myocardial delineation. Based on the success of deep l…
University of Virginia（弗吉尼亚大学）；University of Virginia Health System（弗吉尼亚大学卫生系统）
Automated identification of myocardial scar from late gadolinium enhancement cardiac magnetic resonance images (LGE-CMR) is limited by image noise and artifacts such as those related to motion and partial volume effect. This paper presents a novel joint deep learning (JDL) framework that improves such tasks by utilizing simultaneously learned myocardium segmentations to eliminate negative effects from non-region-of-interest areas. In contrast to previous approaches treating scar detection and myocardium segmentation as separate or parallel tasks, our proposed method introduces a message passin…
Department of Computing, Imperial College London, London, UK（英国伦敦帝国理工学院计算机系）；Division of Cardiovascular Medicine, Radcliffe Department of Medicine, University of Oxford, Oxford, UK（英国牛津大学拉德克利夫医学院心血管医学系）；NIHR Biomedical Research Centre at Barts, Queen Mary University of London, London, UK（英国伦敦玛丽女王大学巴茨国家健康研究所）
Accelerating the acquisition of magnetic resonance imaging (MRI) is a challenging problem, and many works have been proposed to reconstruct images from undersampled k-space data. However, if the main purpose is to extract certain quantitative measures from the images, perfect reconstructions may not always be necessary as long as the images enable the means of extracting the clinically relevant measures. In this paper, we work on jointly predicting cardiac motion estimation and segmentation directly from undersampled data, which are two important steps in quantitatively assessing cardiac funct…
Global and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECG
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany（人工智能在医疗与医学中的研究中心，技术大学慕尼黑（TUM）及慕尼黑技术大学医院）；School of Medicine, Klinikum rechts der Isar, TUM, Germany（医学院，右岸克里克医院，TUM，德国）；Department of Computing, Imperial College London, UK（计算学院，伦敦帝国学院，英国）；Munich Center for Machine Learning (MCML), Munich, Germany（慕尼黑机器学习中心（MCML），慕尼黑，德国）
Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, United States Berlin Ultrahigh Field Facility (B.U.F.F.), Max Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Germany Department of Imaging Physics, Delft University of Technology, Netherlands TUM School of Computation, Information；Technology, Technische Universität München, Germany Department of Surgery, Taipei Veterans General Hospital, Taiwan
Multiparametric mapping MRI has become a viable tool for myocardial tissue characterization. However, misalignment between multiparametric maps makes pixel-wise analysis challenging. To address this challenge, we developed a generalizable physics-informed deep-learning model using test-time adaptation to enable group image registration across contrast weighted images acquired from multiple physical models (e.g., a T1 mapping model and T2 mapping model). The physics-informed adaptation utilized the synthetic images from specific physics model as registration reference, allows for transductive l…
Myocardial T1 mapping is a cardiac MRI technique, used to assess myocardial fibrosis. In this technique, a series of T1-weighted MRI images are acquired with different saturation or inversion times. These images are fitted to the T1 model to estimate the model parameters and construct the desired T1 maps. In the presence of motion, the different T1-weighted images are not aligned. This, in turn, will cause errors and inaccuracies in the final estimation of the T1 maps. Therefore, motion correction is a necessary process for myocardial T1 mapping. We present a deep-learning (DL) based system fo…
Klinikum Rechts der Isar, Technical University of Munich（慕尼黑工业大学伊萨尔河右岸医院）；Imperial College London（伦敦帝国理工学院）；University Hospital of Tübingen（图宾根大学医院）
Motion-compensated MR reconstruction (MCMR) is a powerful concept with considerable potential, consisting of two coupled sub-problems: Motion estimation, assuming a known image, and image reconstruction, assuming known motion. In this work, we propose a learning-based self-supervised framework for MCMR, to efficiently deal with non-rigid motion corruption in cardiac MR imaging. Contrary to conventional MCMR methods in which the motion is estimated prior to reconstruction and remains unchanged during the iterative optimization process, we introduce a dynamic motion estimation process and embed …
National Heart, Lung and Blood Institute, National Institutes of Health（美国国立卫生研究院心肺血液研究所）；Barts Heart Centre, Barts Health NHS Trust（巴特健康国民保健信托巴特心脏中心）；National Amyloidosis Centre, Royal Free Hospital（皇家自由医院国家淀粉样变性病中心）
Purpose: To develop a convolutional neural network (CNN) solution for robust landmark detection in cardiac MR images. Methods: This retrospective study included cine, LGE and T1 mapping scans from two hospitals. The training set included 2,329 patients and 34,019 images. A hold-out test set included 531 patients and 7,723 images. CNN models were developed to detect two mitral valve plane and apical points on long-axis (LAX) images. On short-axis (SAX) images, anterior and posterior RV insertion points and LV center were detected. Model outputs were compared to manual labels by two operators fo…
Istanbul Technical University（伊斯坦布尔理工大学）；King’s College London（伦敦国王学院）
Segmenting anatomical structures in medical images has been successfully addressed with deep learning methods for a range of applications. However, this success is heavily dependent on the quality of the image that is being segmented. A commonly neglected point in the medical image analysis community is the vast amount of clinical images that have severe image artefacts due to organ motion, movement of the patient and/or image acquisition related issues. In this paper, we discuss the implications of image motion artefacts on cardiac MR segmentation and compare a variety of approaches for joint…
Cardiac Magnetic Resonance Imaging (CMR) is widely used since it can illustrate the structure and function of heart in a non-invasive and painless way. However, it is time-consuming and high-cost to acquire the high-quality scans due to the hardware limitation. To this end, we propose a novel end-to-end trainable network to solve CMR video super-resolution problem without the hardware upgrade and the scanning protocol modifications. We incorporate the cardiac knowledge into our model to assist in utilizing the temporal information. Specifically, we formulate the cardiac knowledge as the period…
Columbia University（哥伦比亚大学）；Stevens Institute of Technology（史蒂文斯理工学院）；Imperial College London（帝国理工学院）；Institut Polytechnique de Paris（巴黎理工学院）
Automatically identifying the structural substrates underlying cardiac abnormalities can potentially provide real-time guidance for interventional procedures. With the knowledge of cardiac tissue substrates, the treatment of complex arrhythmias such as atrial fibrillation and ventricular tachycardia can be further optimized by detecting arrhythmia substrates to target for treatment (i.e., adipose) and identifying critical structures to avoid. Optical coherence tomography (OCT) is a real-time imaging modality that aids in addressing this need. Existing approaches for cardiac image analysis main…
Personalized 4D Whole Heart Geometry Reconstruction from Cine MRI for Cardiac Digital Twins
Department of Biomedical Engineering, National University of Singapore, Singapore（新加坡国立大学生物医学工程系）；School of Data Science, Fudan University, Shanghai, China（复旦大学数据科学学院）；Department of Engineering Science, University of Oxford, Oxford, UK（牛津大学工程科学系）；Department of Medicine, National University of Singapore, Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore, Singapore（新加坡国立心脏中心心内科部）
Friedrich-Alexander University（弗里德里希-亚历山大大学）；Siemens Healthineers（西门子医疗）；Johns Hopkins University School of Medicine（约翰·霍普金斯大学医学院）
Electroanatomic mapping as routinely acquired in ablation therapy of ventricular tachycardia is the gold standard method to identify the arrhythmogenic substrate. To reduce the acquisition time and still provide maps with high spatial resolution, we propose a novel deep learning method based on graph convolutional neural networks to estimate the depolarization time in the myocardium, given sparse catheter data on the left ventricular endocardium, ECG, and magnetic resonance images. The training set consists of data produced by a computational model of cardiac electrophysiology on a large cohor…
National Heart and Lung Institute, Imperial College London（帝国理工学院国家心肺研究所）；Royal Brompton Hospital（皇家布朗普顿医院）；University of the Basque Country UPV/EHU（巴斯克大学）；TECNALIA, Basque Research and Technology Alliance（巴斯克研究与技术联盟TECNALIA）；Beihang University（北京航空航天大学）；Shenzhen Second People’s Hospital（深圳市第二人民医院）
Synthetic digital twins based on medical data accelerate the acquisition, labelling and decision making procedure in digital healthcare. A core part of digital healthcare twins is model-based data synthesis, which permits the generation of realistic medical signals without requiring to cope with the modelling complexity of anatomical and biochemical phenomena producing them in reality. Unfortunately, algorithms for cardiac data synthesis have been so far scarcely studied in the literature. An important imaging modality in the cardiac examination is three-directional CINE multi-slice myocardial…
The inverse mechano-electrical problem in cardiac electrophysiology is the attempt to reconstruct electrical excitation or action potential wave patterns from the heart's mechanical deformation that occurs in response to electrical excitation. Because heart muscle cells contract upon electrical excitation due to the excitation-contraction coupling mechanism, the resulting deformation of the heart should reflect macroscopic action potential wave phenomena. However, whether the relationship between macroscopic electrical and mechanical phenomena is well-defined and furthermore unique enough to b…
Purpose: To develop a method for banding-free bSSFP cardiac cine with substantially reduced flow artifacts. Methods: A projection-reconstruction (PR) trajectory is proposed for a frequency-modulated cine sequence, facilitating reconstruction of three phase cycles and a field-map time series from a short, breath-held scan. Data is also acquired during the gradient rewinders to enable generation of field maps using BMART, B$_0$ mapping using rewinding trajectories, where the rewind data forms the second TE image for calculating the field map. A field-map-based combination method is developed whi…
University of Iowa（爱荷华大学）；Philips HealthCare（飞利浦医疗）；University of Wisconsin（威斯康星大学）；GE HealthCare（通用电气医疗）
Free-breathing cardiac MRI schemes are emerging as competitive alternatives to breath-held cine MRI protocols, enabling applicability to pediatric and other population groups that cannot hold their breath. Because the data from the slices are acquired sequentially, the cardiac/respiratory motion patterns may be different for each slice; current free-breathing approaches perform independent recovery of each slice. In addition to not being able to exploit the inter-slice redundancies, manual intervention or sophisticated post-processing methods are needed to align the images post-recovery for qu…
China University of Petroleum（中国石油大学）；Qingdao Women and Children’s Hospital（青岛市妇女儿童医院）
Echocardiography is a powerful prenatal examination tool for early diagnosis of fetal congenital heart diseases (CHDs). The four-chamber (FC) view is a crucial and easily accessible ultrasound (US) image among echocardiography images. Automatic analysis of FC views contributes significantly to the early diagnosis of CHDs. The first step to automatically analyze fetal FC views is locating the fetal four crucial chambers of heart in a US image. However, it is a greatly challenging task due to several key factors, such as numerous speckles in US images, the fetal cardiac chambers with small size …
Shape of my heart: Cardiac models through learned signed distance functions
Institute for Applied Mathematics, University of Bonn（波恩大学应用数学研究所）；University of Graz（格拉茨大学）；Institute for Biological and Medical Engineering, Pontificia Universidad Católica de Chile（智利天主教大学生物与医学工程研究所）；Center for Computational Medicine in Cardiology, Università della Svizzera italiana（瑞士意大利语区大学心血管计算医学中心）；FernUni Schweiz（瑞士远程教育大学）；Instituto Cardiocentro Ticino, EOC（提契诺心脏中心研究所（EOC））；University of Trento（特伦托大学）
Neural Implicit Heart Coordinates: 3D cardiac shape reconstruction from sparse segmentations
School of Biomedical Engineering and Imaging Sciences（生物医学工程与成像科学学院）；William Harvey Research Institute, NIHR Barts Biomedical Research Centre（威廉·哈里森研究机构、NIHR巴茨生物医学研究中心）；Simula Research Laboratory（Simula研究实验室）；Department of Informatics（信息学院）；Department of Bioengineering（生物工程学院）；Barts Heart Centre, Barts Health NHS Trust（巴茨心脏中心、巴茨健康 NHS信托）；Technical University of Munich（慕尼黑技术大学）
DiffCMR: Fast Cardiac MRI Reconstruction with Diffusion Probabilistic Models
The Hong Kong University of Science and Technology（香港科技大学）；Southern University of Science and Technology（南方科技大学）；HKUST Shenzhen Research Institute（香港科技大学深圳研究院）
TAI-GAN: A Temporally and Anatomically Informed Generative Adversarial Network for early-to-late frame conversion in dynamic cardiac PET inter-frame motion correction
Yale University（耶鲁大学）；IBM Research（IBM研究院）；Yale New Haven Hospital（耶鲁-纽黑文医院）；Yale School of Medicine（耶鲁医学院）
MRC London Institute of Medical Sciences（MRC伦敦医学科学研究所）；Imperial College London（帝国理工学院）；National Heart Research Institute Singapore（新加坡国家心脏研究所）；National Heart Center Singapore（新加坡国家心脏中心）；Technical University of Munich（慕尼黑工业大学）
Optimising the analysis of cardiac structure and function requires accurate 3D representations of shape and motion. However, techniques such as cardiac magnetic resonance imaging are conventionally limited to acquiring contiguous cross-sectional slices with low through-plane resolution and potential inter-slice spatial misalignment. Super-resolution in medical imaging aims to increase the resolution of images but is conventionally trained on features from low resolution datasets and does not super-resolve corresponding segmentations. Here we propose a semi-supervised multi-task generative adve…
CineMyoPS: Segmenting Myocardial Pathologies from Cine Cardiac MR
School of Medical Imaging, Fujian Medical University（福建医科大学医学影像学院）；College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；Department of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系）；School of Data Science, Fudan University（复旦大学数据科学学院）；Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University（上海交通大学医学院仁济医院放射科）
An image processing unit (IPU), or image signal processor (ISP) for high dynamic range (HDR) imaging usually consists of demosaicing, white balancing, lens shading correction, color correction, denoising, and tone-mapping. Besides noise from the imaging sensors, almost every step in the ISP introduces or amplifies noise in different ways, and denoising operators are designed to reduce the noise from these sources. Designed for dynamic range compressing, tone-mapping operators in an ISP can significantly amplify the noise level, especially for images captured in low-light conditions, making den…
Full-field surrogate modeling of cardiac function encoding geometric variability
Institute for Computational and Mathematical Engineering, Stanford University（计算与数学工程研究所，斯坦福大学）；Cardiovascular Institute, Stanford University（心血管研究所，斯坦福大学）；Pediatric Cardiology, Stanford University（儿科心脏病学，斯坦福大学）；Department of BioMechanical Engineering, Delft University of Technology（生物机械工程系，代尔夫特理工大学）；IBiTech-bioMMeda, Ghent University（IBiTech-bioMMeda，根特大学）；Pasteur Labs, Brooklyn, NY 11205, USA（Pasteur实验室，布鲁克林，纽约11205，美国）；Department of Bioengineering, Stanford University（生物工程系，斯坦福大学）
Purpose: This work aims to develop a novel distortion-free 3D-EPI acquisition and image reconstruction technique for fast and robust, high-resolution, whole-brain imaging as well as quantitative T2* mapping. Methods: 3D-Blip-Up and -Down Acquisition (3D-BUDA) sequence is designed for both single- and multi-echo 3D GRE-EPI imaging using multiple shots with blip-up and -down readouts to encode B0 field map information. Complementary k-space coverage is achieved using controlled aliasing in parallel imaging (CAIPI) sampling across the shots. For image reconstruction, an iterative hard-thresholdin…
QCResUNet: Joint Subject-level and Voxel-level Segmentation Quality Prediction
Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA；Department of Electrical；Systems Engineering, Washington University in St. Louis, St. Louis, MO, USA；Department of Biomedical Engineering, University of Cincinnati, Cincinnati, OH, USA；Institute for Informatics, Data Science \& Biostatistics, Washington University School of Medicine, St. Louis, MO, USA
Korea Advanced Institute of Science and Technology（韩国科学技术院）
Recent modern displays are now able to render high dynamic range (HDR), high resolution (HR) videos of up to 8K UHD (Ultra High Definition). Consequently, UHD HDR broadcasting and streaming have emerged as high quality premium services. However, due to the lack of original UHD HDR video content, appropriate conversion technologies are urgently needed to transform the legacy low resolution (LR) standard dynamic range (SDR) videos into UHD HDR versions. In this paper, we propose a joint super-resolution (SR) and inverse tone-mapping (ITM) framework, called Deep SR-ITM, which learns the direct ma…
Automated Cardiac Resting Phase Detection Targeted on the Right Coronary Artery
Friedrich-Alexander University Erlangen-Nuremberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；Siemens Healthcare GmbH（西门子医疗有限公司）；Siemens Medical Solutions USA, Inc.（美国西门子医疗解决方案公司）；Jose Michel Kalaf Research Institute（何塞·米歇尔·卡拉夫研究所）；Diagnostikum Berlin（柏林诊断中心）
Gait, as one of unique biometric features, has the advantage of being recognized from a long distance away, can be widely used in public security. Considering 3D pose estimation is more challenging than 2D pose estimation in practice , we research on using 2D joints to recognize gait in this paper, and a new model-based gait recognition method JointsGait is put forward to extract gait information from 2D human body joints. Appearance-based gait recognition algorithms are prevalent before. However, appearance features suffer from external factors which can cause drastic appearance variations, e…
