In this work, we develop a neural network-based method to convert a noisy motion signal generated from segmenting rebinned list-mode cardiac SPECT images, to that of a high-quality surrogate signal, such as those seen from external motion tracking systems (EMTs). This synthetic surrogate will be used as input to our pre-existing motion correction technique developed for EMT surrogate signals. In our method, we test two families of neural networks to translate noisy internal motion to external surrogate: 1) fully connected networks and 2) convolutional neural networks. Our dataset consists of cardiac perfusion SPECT acquisitions for which cardiac motion was estimated (input: center-of-count-mass - COM signals) in conjunction with a respiratory surrogate motion signal acquired using a commercial Vicon Motion Tracking System (GT: EMT signals). We obtained an average R-score of 0.76 between the predicted surrogate and the EMT signal. Our goal is to lay a foundation to guide the optimization of neural networks for respiratory motion correction from SPECT without the need for an EMT.
Yale University（耶鲁大学）；Siemens Medical Solutions USA Inc.（美国西门子医疗解决方案公司）
Tracking organ motion is important in image-guided interventions, but motion annotations are not always easily available. Thus, we propose Repetitive Motion Estimation Network (RMEN) to recover cardiac and respiratory signals. It learns the spatio-temporal repetition patterns, embedding high dimensional motion manifolds to 1D vectors with partial motion phase boundary annotations. Compared with the best alternative models, our proposed RMEN significantly decreased the QRS peaks detection offsets by 59.3%. Results showed that RMEN could handle the irregular cardiac and respiratory motion cases.…
In real-time (RT) cardiac cine imaging, a stack of 2D slices is collected sequentially under free-breathing conditions. A complete heartbeat from each slice is then used for cardiac function quantification. The inter-slice respiratory mismatch can compromise accurate quantification of cardiac function. Methods based on principal components analysis (PCA) have been proposed to extract the respiratory signal from RT cardiac cine, but these methods cannot resolve the inter-slice sign ambiguity of the respiratory signal. In this work, we propose a fully automatic sign correction procedure based on…
Fudan University（复旦大学）；Imperial College London（帝国理工学院）；University of Oxford（牛津大学）；Zhongshan Hospital Affiliated to Fudan University（复旦大学附属中山医院）
The quality of cardiac magnetic resonance (CMR) imaging is susceptible to respiratory motion artifacts. The model robustness of automated segmentation techniques in face of real-world respiratory motion artifacts is unclear. This manuscript describes the design of extreme cardiac MRI analysis challenge under respiratory motion (CMRxMotion Challenge). The challenge aims to establish a public benchmark dataset to assess the effects of respiratory motion on image quality and examine the robustness of segmentation models. The challenge recruited 40 healthy volunteers to perform different breath-ho…
Purpose: To develop a fully automatic method for extraction and directionality determination of respiratory signal in free-breathing, real-time (RT) cardiac MRI. Methods: The respiratory signal is extracted by a principal component analysis method from RT cine images. Then, a two-step procedure is used to determine the directionality (sign) of the respiratory signal. First, the signal polarity of all slices is made consistent with a reference slice. Second, a global sign correction is performed by maximizing the correlation of the respiratory signal with the zeroth-moment center curve. The pro…
Dublin City University（都柏林城市大学）；University College Dublin（都柏林大学学院）
Methods that are resilient to artifacts in the cardiac magnetic resonance imaging (MRI) while performing ventricle segmentation, are crucial for ensuring quality in structural and functional analysis of those tissues. While there has been significant efforts on improving the quality of the algorithms, few works have tackled the harm that the artifacts generate in the predictions. In this work, we study fine tuning of pretrained networks to improve the resilience of previous methods to these artifacts. In our proposed method, we adopted the extensive usage of data augmentations that mimic those…
Respiratory motion can cause strong blurring artifacts in the reconstructed image during MR acquisition. These artifacts become more prominent when use in the presence of undersampled data. Recently, compressed sensing (CS) is developed as an MR reconstruction technique, to recover good quality images from the compressive k-space samples. To maximize the benefits of CS in free breathing data, it is understandable to use CS with the motion corrected images. In this paper, we have developed a new CS based motion corrected image reconstruction technique. In this two-stage technique, we use simila…
Full-field surrogate modeling of cardiac function encoding geometric variability
Institute for Computational and Mathematical Engineering, Stanford University（计算与数学工程研究所，斯坦福大学）；Cardiovascular Institute, Stanford University（心血管研究所，斯坦福大学）；Pediatric Cardiology, Stanford University（儿科心脏病学，斯坦福大学）；Department of BioMechanical Engineering, Delft University of Technology（生物机械工程系，代尔夫特理工大学）；IBiTech-bioMMeda, Ghent University（IBiTech-bioMMeda，根特大学）；Pasteur Labs, Brooklyn, NY 11205, USA（Pasteur实验室，布鲁克林，纽约11205，美国）；Department of Bioengineering, Stanford University（生物工程系，斯坦福大学）
Motion free reconstruction of compressively sampled cardiac perfusion MR images is a challenging problem. It is due to the aliasing artifacts and the rapid contrast changes in the reconstructed perfusion images. In addition to the reconstruction limitations, many registration algorithms under perform in the presence of the rapid intensity changes. In this paper, we propose a novel motion correction method that reconstructs the motion free image series from the undersampled cardiac perfusion MR data. The motion correction method uses the novel robust principal component analysis based reconstru…
Fudan University（复旦大学）；Imperial College London（帝国理工学院）；University of Edinburgh（爱丁堡大学）；MRC London Institute of Medical Sciences（英国医学研究委员会伦敦医学科学研究所）；National Heart Research Institute, Singapore（新加坡国家心脏研究所）
In cardiac magnetic resonance (CMR) imaging, a 3D high-resolution segmentation of the heart is essential for detailed description of its anatomical structures. However, due to the limit of acquisition duration and respiratory/cardiac motion, stacks of multi-slice 2D images are acquired in clinical routine. The segmentation of these images provides a low-resolution representation of cardiac anatomy, which may contain artefacts caused by motion. Here we propose a novel latent optimisation framework that jointly performs motion correction and super resolution for cardiac image segmentations. Give…
Extreme Cardiac MRI Analysis under Respiratory Motion: Results of the CMRxMotion Challenge
Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai, Shanghai 200032, China；Shanghai Key Laboratory of MICCAI, Fudan University, Shanghai, Shanghai 200032, China；Department of Electrical；Electronic Engineering \& I-X, Imperial College London, London, London SW7 2AZ, United Kingdom；Department of Radiology, Zhongshan Hospital Affiliated to Fudan University, Shanghai, Shanghai 200032, China；Department of Computing, Imperial College London, London, London SW7 2AZ, United Kingdom；School of Computer Science, University of Sheffield, Sheffield, S1 4DP, United Kingdom；Department of Engineering Science, University of Oxford, Oxford, OX2 0ES, United Kingdom；Shanghai Pudong Hospital；Human Phenome Institute, Fudan University, Shanghai, 201203, China；School of Computer Science, University of Nottingham, Nottingham, NG8 1BB, United Kingdom；Diagnostic Imaging, University of Alberta, Edmonton, AB T6G 1K4, Canada；Department of Computer Science；Engineering, The Chinese University of Hong Kong, Hong Kong, Hong Kong 000000, China；The D-Lab, Department of Precision Medicine, GROW - Research Institute for Oncology；Reproduction, Maastricht University, 6220 MD Maastricht, The Netherlands；Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven 5612 AZ, The Netherlands；Department of Radiology, Northwestern University, 737 N. Michigan Ave, Suite 1600, Chicago 60611, United States；United Imaging Research, 393 Middle Huaxia Road, Pudong, Shanghai 201210, China；Division of Image Processing, Department of Radiology, Leiden University Medical Center, PO Box 9600, Leiden 2300 RC, The Netherlands；Université Bourgogne Europe, CNRS, ICMUB UMR 6302, 21000 Dijon, France；Istanbul Technical University, Maslak, 34467, İstanbul, Türkiye；Computer Science, Technical University of Darmstadt, Karolinenpl. 5, 64289 Darmstadt, Germany；Lung Institute, Faculty of Medicine, Imperial College London, Guy Scadding Building, Cale Street, London, SW3 6LY,United Kingdom；Hawkes Institute, Department of Computer Science, University College London, 66-72 Gower St, London, United Kingdom；School of Medicine, University College Dublin, Belfield, Dublin, D04 V1W8, Ireland；CeADAR: Ireland's Centre for AI, University College Dublin, Belfield, Dublin, D04 V1W8, Ireland；Sano Centre for Computational Medicine, Czarnowiejska 36, 30-054, Krakow, Poland；Faculty of Mathematics；Computer Science, Jagiellonian University, S. Łojasiewicza 6, Krakow, Poland；Department of Electronic；Computer Engineering, The Hong Kong University of Science；School of Instrument Science；Engineering, Southeast University, Nanjing, Nanjing 210096, China；College of Artificial Intelligence, Nanjing University of Aeronautics；Academy for Engineering；Technology, Fudan University, Shanghai, Shanghai 200433, China；College of Biomedical Engineering, Fudan University, Shanghai, Shanghai 200433, China；Institute of Science；Technology for Brain-inspired Intelligence, Fudan University, Shanghai, Shanghai 200433, China；Department of Brain Sciences, Imperial College London, London, London SW7 2AZ, United Kingdom；Data Science Institute, Imperial College London, London, London SW7 2AZ, United Kingdom
The MR-Linac is a combination of an MR-scanner and radiotherapy linear accelerator (Linac) which holds the promise to increase the precision of radiotherapy treatments with MR-guided radiotherapy by monitoring motion during radiotherapy with MRI, and adjusting the radiotherapy plan accordingly. Optimal MR-guidance for respiratory motion during radiotherapy requires MR-based 3D motion estimation with a latency of 200-500 ms. Currently this is still challenging since typical methods rely on MR-images, and are therefore limited by the 3D MR-imaging latency. In this work, we present a method to pe…
Background: RSN whole-heart CMRA is a technique that estimates and corrects for respiratory motion. However, RSN has been limited to a 1D rigid correction which is often insufficient for patients with complex respiratory patterns. The goal of this work is therefore to improve the robustness and quality of 3D radial CMRA by incorporating both 3D motion information and nonrigid intra-acquisition correction of the data into a framework called focused navigation (fNAV). Methods: We applied fNAV to 500 data sets from a numerical simulation, 22 healthy volunteers, and 549 cardiac patients. We compar…
The Hamlyn Centre for Robotic Surgery, Imperial College London（帝国理工学院哈姆林机器人外科中心）；Department of Computing, Imperial College London（帝国理工学院计算机系）；Cardiovascular Biomedical Research Unit, Royal Brompton Hospital（皇家布朗普顿医院心血管生物医学研究中心）
Purpose: Advancements in MRI Tissue Phase Velocity Mapping (TPM) allow for the acquisition of higher quality velocity cardiac images providing better assessment of regional myocardial deformation for accurate disease diagnosis, pre-operative planning and post-operative patient surveillance. Translation of TPM velocities from the scanner's reference coordinate system to the regional cardiac coordinate system requires decoupling of translational motion and motion due to myocardial deformation. Despite existing techniques for respiratory motion compensation in TPM, there is still a remaining tran…
