The Challenge of Fetal Cardiac MRI Reconstruction Using Deep Learning
King’s College London（伦敦国王学院）；Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；Guy’s & St. Thomas’ NHS Foundation Trust（盖伊和圣托马斯国民保健服务基金会信托）；Evelina London Children’s Hospital（伊夫琳娜伦敦儿童医院）
Denis Prokopenko, Kerstin Hammernik, Thomas Roberts, David F A Lloyd, Daniel Rueckert, Joseph V Hajnal
Dynamic free-breathing fetal cardiac MRI is one of the most challenging modalities, which requires high temporal and spatial resolution to depict rapid changes in a small fetal heart. The ability of deep learning methods to recover undersampled data could help to optimise the kt-SENSE acquisition strategy and improve non-gated kt-SENSE reconstruction quality. In this work, we explore supervised deep learning networks for reconstruction of kt-SENSE style acquired data using an extensive in vivo dataset. Having access to fully-sampled low-resolution multi-coil fetal cardiac MRI, we study the performance of the networks to recover fully-sampled data from undersampled data. We consider model architectures together with training strategies taking into account their application in the real clinical setup used to collect the dataset to enable networks to recover prospectively undersampled data. We explore a set of modifications to form a baseline performance evaluation for dynamic fetal cardiac MRI on real data. We systematically evaluate the models on coil-combined data to reveal the effect of the suggested changes to the architecture in the context of fetal heart properties. We show that the best-performers recover a detailed depiction of the maternal anatomy on a large scale, but the dynamic properties of the fetal heart are under-represented. Training directly on multi-coil data improves the performance of the models, allows their prospective application to undersampled data and makes them outperform CTFNet introduced for adult cardiac cine MRI. However, these models deliver similar qualitative performances recovering the maternal body very well but underestimating the dynamic properties of fetal heart. This dynamic feature of fast change of fetal heart that is highly localised suggests both more targeted training and evaluation methods might be needed for fetal heart application.
Improving cross-domain brain tissue segmentation in fetal MRI with synthetic data
Lausanne University Hospital（洛桑大学医院）；University of Lausanne (UNIL)（洛桑大学）；CIBM Center for Biomedical Imaging（CIBM生物医学成像中心）；King’s College London（伦敦国王学院）；FAU Erlangen-Nuremberg（埃尔朗根-纽伦堡大学）
MIT（麻省理工学院）；Tsinghua University（清华大学）；Boston Children’s Hospital（波士顿儿童医院）；Harvard Medical School（哈佛医学院）
The performance and diagnostic utility of magnetic resonance imaging (MRI) in pregnancy is fundamentally constrained by fetal motion. Motion of the fetus, which is unpredictable and rapid on the scale of conventional imaging times, limits the set of viable acquisition techniques to single-shot imaging with severe compromises in signal-to-noise ratio and diagnostic contrast, and frequently results in unacceptable image quality. Surprisingly little is known about the characteristics of fetal motion during MRI and here we propose and demonstrate methods that exploit a growing repository of MRI ob…
DCRA-Net: Attention-Enabled Reconstruction Model for Dynamic Fetal Cardiac MRI
King’s College London（伦敦国王学院）；Evelina London Children’s Hospital（伊芙琳娜伦敦儿童医院）；Imperial College London（帝国理工学院）；Klinikum rechts der Isar, Technical University of Munich（慕尼黑工业大学右岸医院）
MIT（麻省理工学院）；Boston Children’s Hospital（波士顿儿童医院）；Harvard Medical School（哈佛医学院）
Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly performed by fast, single-shot MRI and retrospective motion correction. Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigate fetal motion artifacts where inferred fetal motion is combined with online slice prescription with low-latency decision making. Current developments of deep reinforcement learning (DRL), offer a nov…
Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for anomaly screening. For this ultrasound (US) is employed. While expert sonographers are adept at reading US images, MR images are much easier for non-experts to interpret. Hence in this paper we seek to produce images with MRI-like appearance directly from clinical US images. Our own clinical motivation is to seek a way to communicate US findings to patients or clinical professionals unfamiliar with US, but in medical image analysis such a capability is potentially useful, for in…
Northeastern University（东北大学）；Boston Children’s Hospital（波士顿儿童医院）；Harvard Medical School（哈佛医学院）
Fetal brain segmentation is an important first step for slice-level motion correction and slice-to-volume reconstruction in fetal MRI. Fast and accurate segmentation of the fetal brain on fetal MRI is required to achieve real-time fetal head pose estimation and motion tracking for slice re-acquisition and steering. To address this critical unmet need, in this work we analyzed the speed-accuracy performance of a variety of deep neural network models, and devised a symbolically small convolutional neural network that combines spatial details at high resolution with context features extracted at …
Enhancing Generalized Fetal Brain MRI Segmentation using A Cascade Network with Depth-wise Separable Convolution and Attention Mechanism
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University（复旦大学类脑智能科学与技术研究院）；MOE Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence（教育部计算神经科学与类脑智能重点实验室）；MOE Frontiers Center for Brain Science（教育部脑科学前沿中心）
The Hebrew University of Jerusalem（耶路撒冷希伯来大学）；Sagol Brain Institute, Tel Aviv Sourasky Medical Center（特拉维夫苏拉斯基医疗中心萨戈尔脑研究所）；Tel Aviv University（特拉维夫大学）；Tel Aviv Sourasky Medical Center（特拉维夫苏拉斯基医疗中心）；University of Ottawa（渥太华大学）；Children's Hospital of Eastern Ontario（东安大略儿童医院）；Shaare Zedek Medical Center（沙雷泽德克医疗中心）
Timely, accurate and reliable assessment of fetal brain development is essential to reduce short and long-term risks to fetus and mother. Fetal MRI is increasingly used for fetal brain assessment. Three key biometric linear measurements important for fetal brain evaluation are Cerebral Biparietal Diameter (CBD), Bone Biparietal Diameter (BBD), and Trans-Cerebellum Diameter (TCD), obtained manually by expert radiologists on reference slices, which is time consuming and prone to human error. The aim of this study was to develop a fully automatic method computing the CBD, BBD and TCD measurements…
Imperial College London（伦敦帝国学院）；King’s College London（伦敦国王学院）；FAU Erlangen-Nürnberg（埃尔朗根-纽伦堡大学）；Technical University of Munich（慕尼黑工业大学）
Fetal Magnetic Resonance Imaging (MRI) is used in prenatal diagnosis and to assess early brain development. Accurate segmentation of the different brain tissues is a vital step in several brain analysis tasks, such as cortical surface reconstruction and tissue thickness measurements. Fetal MRI scans, however, are prone to motion artifacts that can affect the correctness of both manual and automatic segmentation techniques. In this paper, we propose a novel network structure that can simultaneously generate conditional atlases and predict brain tissue segmentation, called CAS-Net. The condition…
University Hospitals Leuven（鲁汶大学医院）；University Hospitals Tanta（坦塔大学医院）；University College London（伦敦大学学院）
Deep neural networks have increased the accuracy of automatic segmentation, however, their accuracy depends on the availability of a large number of fully segmented images. Methods to train deep neural networks using images for which some, but not all, regions of interest are segmented are necessary to make better use of partially annotated datasets. In this paper, we propose the first axiomatic definition of label-set loss functions that are the loss functions that can handle partially segmented images. We prove that there is one and only one method to convert a classical loss function for fu…
The Hebrew University of Jerusalem（耶路撒冷希伯来大学）；Sagol Brain Institute, Tel Aviv Sourasky Medical Center（特拉维夫苏拉斯基医疗中心萨戈尔脑研究所）；Tel Aviv University（特拉维夫大学）
Volumetric measurements of fetal structures in MRI are time consuming and error prone and therefore require automatic segmentation. Placenta segmentation and accurate fetal brain segmentation for gyrification assessment are particularly challenging because of the placenta fuzzy boundaries and the fetal brain cortex complex foldings. In this paper, we study the use of the Contour Dice loss for both problems and compare it to other boundary losses and to the combined Dice and Cross-Entropy loss. The loss is computed efficiently for each slice via erosion, dilation and XOR operators. We describe …
Deep Learning-Based Fetal Lung Segmentation from Diffusion-weighted MRI Images and Lung Maturity Evaluation for Fetal Growth Restriction
School of Biomedical Engineering and Imaging Sciences, King's College London, London, UK（生物医学工程与成像科学学院，伦敦国王学院）；Elizabeth Garrett Anderson Institute for Women’s Health, University College, London, UK（埃利扎贝塔·加德纳妇女健康研究所，大学学院，伦敦）；University College London Hospital NHS Foundation Trust, London, UK（伦敦大学学院医院国家健康服务信托基金）；Department of Medical Physics and Biomedical Engineering, University College London Hospitals, London, UK（医学物理与生物医学工程系，伦敦大学学院医院）；Department of Radiology, University College London Hospitals NHS Foundation Trust, London, United Kingdom（放射科，伦敦大学学院医院国家健康服务信托基金）
United Imaging Intelligence（联影智能）；UIH America, Inc.（联影美国公司）；United Imaging Healthcare（联影医疗）
Retrospectively gated cine (retro-cine) MRI is the clinical standard for cardiac functional analysis. Deep learning (DL) based methods have been proposed for the reconstruction of highly undersampled MRI data and show superior image quality and magnitude faster reconstruction time than CS-based methods. Nevertheless, it remains unclear whether DL reconstruction is suitable for cardiac function analysis. To address this question, in this study we evaluate and compare the cardiac functional values (EDV, ESV and EF for LV and RV, respectively) obtained from highly accelerated MRI acquisition usin…
University of Electronic Science and Technology of China（电子科技大学）；King’s College London（伦敦国王学院）；University Hospitals KU Leuven（鲁汶大学附属医院）；University College London（伦敦大学学院）；SenseTime Research（商汤科技研究院）
Segmentation of the fetal brain from stacks of motion-corrupted fetal MRI slices is important for motion correction and high-resolution volume reconstruction. Although Convolutional Neural Networks (CNNs) have been widely used for automatic segmentation of the fetal brain, their results may still benefit from interactive refinement for challenging slices. To improve the efficiency of interactive refinement process, we propose an Uncertainty-Guided Interactive Refinement (UGIR) framework. We first propose a grouped convolution-based CNN to obtain multiple automatic segmentation predictions with…
Detailed delineation of the fetal brain in diffusion MRI via multi-task learning
Harvard Medical School（哈佛医学院）；Elmhurst Hospital Center（埃尔姆赫斯特医院中心）；Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院）；Massachusetts General Hospital（麻省总医院）；University of California Irvine（加州大学欧文分校）
University Medical Center Utrecht（乌得勒支大学医学中心）；Wilhelmina Children’s Hospital（威廉明娜儿童医院）；Utrecht University（乌得勒支大学）
MR images of fetuses allow clinicians to detect brain abnormalities in an early stage of development. The cornerstone of volumetric and morphologic analysis in fetal MRI is segmentation of the fetal brain into different tissue classes. Manual segmentation is cumbersome and time consuming, hence automatic segmentation could substantially simplify the procedure. However, automatic brain tissue segmentation in these scans is challenging owing to artifacts including intensity inhomogeneity, caused in particular by spontaneous fetal movements during the scan. Unlike methods that estimate the bias f…
Fetal cortical plate segmentation is essential in quantitative analysis of fetal brain maturation and cortical folding. Manual segmentation of the cortical plate, or manual refinement of automatic segmentations is tedious and time-consuming. Automatic segmentation of the cortical plate, on the other hand, is challenged by the relatively low resolution of the reconstructed fetal brain MRI scans compared to the thin structure of the cortical plate, partial voluming, and the wide range of variations in the morphology of the cortical plate as the brain matures during gestation. To reduce the burde…
A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation
University Hospitals Leuven（鲁汶大学医院）；Technical University Munich（慕尼黑工业大学）；University Hospital Zurich（苏黎世大学医院）；University of Zurich（苏黎世大学）；University College London（伦敦大学学院）；University Hospitals Tanta（坦塔大学医院）；Medical University of Vienna（维也纳医科大学）
Equivariant symmetry-aware head pose estimation for fetal MRI
MIT Computer Science and Artificial Intelligence Laboratory（麻省理工学院计算机科学与人工智能实验室）；Boston Children's Hospital and Harvard Medical School（波士顿儿童医院和哈佛医学院）；Inria, Université Côte d'Azur（法国国家科学研究中心（Inria）、蔚蓝海岸大学）
Quantitative analysis of fetal lung Diffusion-Weighted MRI (DWI) data shows potential in providing quantitative imaging biomarkers that indirectly reflect fetal lung maturation. However, fetal motion during the acquisition hampered quantitative analysis of the acquired DWI data and, consequently, reliable clinical utilization. We introduce qDWI-morph, an unsupervised deep-neural-network architecture for motion compensated quantitative DWI (qDWI) analysis. Our approach couples a registration sub-network with a quantitative DWI model fitting sub-network. We simultaneously estimate the qDWI param…
School of Biomedical Engineering & Imaging Sciences, King’s College London, UK（伦敦国王学院生物医学工程与成像科学学院）；Department of Radiology, University Hospitals Leuven, Belgium（鲁汶大学医院放射科）；Institute for Women’s Health, University College London, UK（伦敦大学学院妇女健康研究所）；Department of Obstetrics and Gynaecology, University Hospitals Leuven, Belgium（鲁汶大学医院妇产科）；Department of Gynecology and Obstetrics, University Hospitals Tanta, Egypt（坦塔大学医院妇产科）；Department of Biomedical Imaging and Image-guided Therapy Medical University of Vienna, Austria（维也纳医科大学生物医学成像与图像引导治疗系）
The performance of deep neural networks typically increases with the number of training images. However, not all images have the same importance towards improved performance and robustness. In fetal brain MRI, abnormalities exacerbate the variability of the developing brain anatomy compared to non-pathological cases. A small number of abnormal cases, as is typically available in clinical datasets used for training, are unlikely to fairly represent the rich variability of abnormal developing brains. This leads machine learning systems trained by maximizing the average performance to be biased t…
In recent years, convolutional neural networks have demonstrated promising performance in a variety of medical image segmentation tasks. However, when a trained segmentation model is deployed into the real clinical world, the model may not perform optimally. A major challenge is the potential poor-quality segmentations generated due to degraded image quality or domain shift issues. There is a timely need to develop an automated quality control method that can detect poor segmentations and feedback to clinicians. Here we propose a novel deep generative model-based framework for quality control …
AtlasSeg: Atlas Prior Guided Dual-U-Net for Cortical Segmentation in Fetal Brain MRI
College of Biomedical Engineering & Instrument Science, Zhejiang University（浙江大学生物医学工程与仪器科学学院）；Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences（中国医学科学院北京医院国家老年医学中心老年医学研究所）；Shandong Provincial Hospital Affiliated to Shandong First Medical University（山东第一医科大学附属山东省立医院）；State Key Lab of CAD&CG, Zhejiang University（浙江大学CAD&CG国家重点实验室）
School of Biomedical Engineering & Imaging Sciences, King’s College London, UK（伦敦国王学院生物医学工程与成像科学学院）；Technical University of Munich, Germany（慕尼黑工业大学）；Biomedical Image Analysis Group, Imperial College London, UK（帝国理工学院生物医学图像分析组）；Department of Adult and Paediatric Cardiology, Guy’s and St Thomas’ NHS Foundation Trust, London, UK（盖伊和圣托马斯国民健康服务信托基金会成人及儿科心脏病科）；Coimbra Institute for Biomedical Imaging and Translational Research, University of Coimbra, Portugal（科英布拉大学科英布拉生物医学成像与转化研究学院）；Helmholtz Center Munich, Germany（慕尼黑亥姆霍兹中心）
Cine cardiac MRI is routinely acquired for the assessment of cardiac health, but the imaging process is slow and typically requires several breath-holds to acquire sufficient k-space profiles to ensure good image quality. Several undersampling-based reconstruction techniques have been proposed during the last decades to speed up cine cardiac MRI acquisition. However, the undersampling factor is commonly fixed to conservative values before acquisition to ensure diagnostic image quality, potentially leading to unnecessarily long scan times. In this paper, we propose an end-to-end quality-aware c…
Rutgers University（罗格斯大学）；United Imaging Intelligence（联影智能）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
Accurate estimation of shape thickness from medical images is crucial in clinical applications. For example, the thickness of myocardium is one of the key to cardiac disease diagnosis. While mathematical models are available to obtain accurate dense thickness estimation, they suffer from heavy computational overhead due to iterative solvers. To this end, we propose novel methods for dense thickness estimation, including a fast solver that estimates thickness from binary annular shapes and an end-to-end network that estimates thickness directly from raw cardiac images.We test the proposed model…
In most medical image processing tasks, the orientation of an image would affect computing result. However, manually reorienting images wastes time and effort. In this paper, we study the problem of recognizing orientation in cardiac MRI and using deep neural network to solve this problem. For multiple sequences and modalities of MRI, we propose a transfer learning strategy, which adapts our proposed model from a single modality to multiple modalities. We also propose a prediction method that uses voting. The results shows that deep neural network is an effective way in recognition of cardiac …
Low-rank tensor models have been applied in accelerating dynamic magnetic resonance imaging (dMRI). Recently, a new tensor nuclear norm based on t-SVD has been proposed and applied to tensor completion. Inspired by the different properties of the tensor nuclear norm (TNN) and the Casorati matrix nuclear norm (MNN), we introduce a combined TNN and Casorati MNN regularizations framework to reconstruct dMRI, which we term as TMNN. The proposed method simultaneously exploits the spatial structure and the temporal correlation of the dynamic MR data. The optimization problem can be efficiently solve…
University of Bourgogne Franche-Comte（勃艮第-弗朗什-孔泰大学）；CASIS inc.（CASIS公司）；University of Sherbrooke（舍布鲁克大学）；University Hospital of Dijon（第戎大学医院）
Deep learning methods are the de-facto solutions to a multitude of medical image analysis tasks. Cardiac MRI segmentation is one such application which, like many others, requires a large number of annotated data so a trained network can generalize well. Unfortunately, the process of having a large number of manually curated images by medical experts is both slow and utterly expensive. In this paper, we set out to explore whether expert knowledge is a strict requirement for the creation of annotated datasets that machine learning can successfully train on. To do so, we gauged the performance o…
Zhejiang University（浙江大学）；University of Notre Dame（圣母大学）
Automatic segmentation of cardiac magnetic resonance imaging (MRI) facilitates efficient and accurate volume measurement in clinical applications. However, due to anisotropic resolution and ambiguous border (e.g., right ventricular endocardium), existing methods suffer from the degradation of accuracy and robustness in 3D cardiac MRI video segmentation. In this paper, we propose a novel Deformable U-Net (DeU-Net) to fully exploit spatio-temporal information from 3D cardiac MRI video, including a Temporal Deformable Aggregation Module (TDAM) and a Deformable Global Position Attention (DGPA) net…
In this paper, we study the problem of imaging orientation in cardiac MRI, and propose a framework to categorize the orientation for recognition and standardization via deep neural networks. The method uses a new multi-tasking strategy, where both the tasks of cardiac segmentation and orientation recognition are simultaneously achieved. For multiple sequences and modalities of MRI, we propose a transfer learning strategy, which adapts our proposed model from a single modality to multiple modalities. We embed the orientation recognition network in a Cardiac MRI Orientation Adjust Tool, i.e., CM…
Department of Radiology, Massachusetts General Hospital（麻省总医院放射科）；Radiology, Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院放射科）
In fetal-brain MRI, head-pose changes between prescription and acquisition present a challenge to obtaining the standard sagittal, coronal and axial views essential to clinical assessment. As motion limits acquisitions to thick slices that preclude retrospective resampling, technologists repeat ~55-second stack-of-slices scans (HASTE) with incrementally reoriented field of view numerous times, deducing the head pose from previous stacks. To address this inefficient workflow, we propose a robust head-pose detection algorithm using full-uterus scout scans (EPI) which take ~5 seconds to acquire. …
Universidad Politécnica de Madrid（马德里理工大学）；Biomedical Research Networking Center in Bioengineering, Biomaterials and Nanomedicine (CIBER-BBN)（生物医学研究网络中心（生物工程、生物材料与纳米医学））；King’s College London（伦敦国王学院）
Magnetic resonance imaging of whole fetal body and placenta is limited by different sources of motion affecting the womb. Usual scanning techniques employ single-shot multi-slice sequences where anatomical information in different slices may be subject to different deformations, contrast variations or artifacts. Volumetric reconstruction formulations have been proposed to correct for these factors, but they must accommodate a non-homogeneous and non-isotropic sampling, so regularization becomes necessary. Thus, in this paper we propose a deep generative prior for robust volumetric reconstructi…
University College London（伦敦大学学院）；Centre for Medical Image Computing（医学图像计算中心）
Accurate segmentation of the right ventricle (RV) is a crucial step in the assessment of the ventricular structure and function. Yet, due to its complex anatomy and motion segmentation of the RV has not been as largely studied as the left ventricle. This paper presents a fully automatic method for the segmentation of the RV in cardiac magnetic resonance images (MRI). The method uses a coarse-to-fine segmentation strategy in combination with a multi-atlas propagation segmentation framework. Based on a cross correlation metric, our method selects the best atlases for propagation allowing the ref…
The Hebrew University of Jerusalem（耶路撒冷希伯来大学）；Sagol Brain Institute, Tel Aviv Medical Center（特拉维夫医疗中心萨戈尔脑研究所）；Tel Aviv Medical Center（特拉维夫医疗中心）；Tel Aviv University（特拉维夫大学）；Tel Aviv Sourasky Medical Center（特拉维夫苏拉斯基医疗中心）
Normal fetal adipose tissue (AT) development is essential for perinatal well-being. AT, or simply fat, stores energy in the form of lipids. Malnourishment may result in excessive or depleted adiposity. Although previous studies showed a correlation between the amount of AT and perinatal outcome, prenatal assessment of AT is limited by lacking quantitative methods. Using magnetic resonance imaging (MRI), 3D fat- and water-only images of the entire fetus can be obtained from two point Dixon images to enable AT lipid quantification. This paper is the first to present a methodology for developing …
Evaluating Synthetic Data Generation for Domain Generalization in Fetal Brain MRI Segmentation
Department of Radiology, Lausanne University Hospital and University of Lausanne (UNIL)（拉沃斯大学医院放射科和洛桑大学（UNIL））；CIBM Center for Biomedical Imaging（生物医学成像中心）；Institute for Information Processing, Leibniz University Hannover（汉诺威莱比锡大学信息处理研究所）；Department of Biomedical Engineering, School of Biomedical Engineering & Imaging Sciences, King’s College London（伦敦国王学院生物医学工程系）；Department of Biomedical Imaging and Image-Guided Therapy, Division of Neuroradiology and Musculoskeletal Radiology, Medical University of Vienna（维也纳医学大学生物医学成像与影像引导治疗系）；Department of Biomedical Imaging and Image-guided Therapy, Computational Imaging Research Lab (CIR), Medical University of Vienna（维也纳医学大学生物医学成像与影像引导治疗系，计算成像研究实验室（CIR））；Christian Doppler Laboratory for Mathematical Modelling and Simulation of Next-Generation Medical Ultrasound Devices, Medical University of Vienna（维也纳医学大学下一代医学超声设备数学建模与仿真克里斯蒂安多普勒实验室）；Comprehensive Center for Artificial Intelligence in Medicine, Medical University of Vienna（维也纳医学大学人工智能在医学中的综合中心）；Division of Neuroradiology and Musculoskeletal Radiology, Department of Biomedical Imaging and Image–guided Therapy, Medical University of Vienna（维也纳医学大学生物医学成像与影像引导治疗系，神经放射学和骨科放射学系）
Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University（复旦大学类脑智能科学与技术研究院）
In this paper, the problem of orientation correction in cardiac MRI images is investigated and a framework for orientation recognition via deep neural networks is proposed. For multi-modality MRI, we introduce a transfer learning strategy to transfer our proposed model from single modality to multi-modality. We embed the proposed network into the orientation correction command-line tool, which can implement orientation correction on 2D DICOM and 3D NIFTI images. Our source code, network models and tools are available at https://github.com/Jy-stdio/MSCMR_orient/
Personalized 4D Whole Heart Geometry Reconstruction from Cine MRI for Cardiac Digital Twins
Department of Biomedical Engineering, National University of Singapore, Singapore（新加坡国立大学生物医学工程系）；School of Data Science, Fudan University, Shanghai, China（复旦大学数据科学学院）；Department of Engineering Science, University of Oxford, Oxford, UK（牛津大学工程科学系）；Department of Medicine, National University of Singapore, Singapore（新加坡国立大学医学系）；Department of Cardiology, National University Heart Centre Singapore, Singapore（新加坡国立心脏中心心内科部）
In this paper we present a novel method for the correction of motion artifacts that are present in fetal Magnetic Resonance Imaging (MRI) scans of the whole uterus. Contrary to current slice-to-volume registration (SVR) methods, requiring an inflexible anatomical enclosure of a single investigated organ, the proposed patch-to-volume reconstruction (PVR) approach is able to reconstruct a large field of view of non-rigidly deforming structures. It relaxes rigid motion assumptions by introducing a specific amount of redundant information that is exploited with parallelized patch-wise optimization…
Towards contrast- and pathology-agnostic clinical fetal brain MRI segmentation using SynthSeg
University Children’s Hospital Zurich（苏黎世大学儿童医院）；ETH Zurich（苏黎世联邦理工学院）；University of Zurich（苏黎世大学）；Medical University of Vienna（维也纳医科大学）；CIBM Center for Biomedical Imaging（CIBM生物医学成像中心）；University of Lausanne（洛桑大学）；Lausanne University Hospital（洛桑大学医院）；King's College London（伦敦国王学院）；University Hospital Erlangen（埃尔朗根大学医院）；Spanish National Research Council (CSIC)（西班牙国家研究委员会）；Universitat Politècnica de València（瓦伦西亚理工大学）
University of Notre Dame（圣母大学）；IBM Thomas J. Watson Research Center（IBM托马斯·J·沃森研究中心）；Guangdong General Hospital（广东省人民医院）
Cardiac magnetic resonance imaging (MRI) is an essential tool for MRI-guided surgery and real-time intervention. The MRI videos are expected to be segmented on-the-fly in real practice. However, existing segmentation methods would suffer from drastic accuracy loss when modified for speedup. In this work, we propose Multiscale Statistical U-Net (MSU-Net) for real-time 3D MRI video segmentation in cardiac surgical guidance. Our idea is to model the input samples as multiscale canonical form distributions for speedup, while the spatio-temporal correlation is still fully utilized. A parallel stati…
University of Notre Dame（圣母大学）；Guangdong Provincial People’s Hospital（广东省人民医院）；IBM Thomas J. Watson Research Center（IBM托马斯·J·沃森研究中心）
Real-time cine magnetic resonance imaging (MRI) plays an increasingly important role in various cardiac interventions. In order to enable fast and accurate visual assistance, the temporal frames need to be segmented on-the-fly. However, state-of-the-art MRI segmentation methods are used either offline because of their high computation complexity, or in real-time but with significant accuracy loss and latency increase (causing visually noticeable lag). As such, they can hardly be adopted to assist visual guidance. In this work, inspired by a new interpretation of Independent Component Analysis …
University of Sherbrooke（舍布鲁克大学）；Université de Bourgogne Franche-Comté（勃艮第-弗朗什孔泰大学）；CArdiac Simulation & Imaging Software（心脏模拟与成像软件公司）；Université de Lyon（里昂大学）
Recent publications have shown that the segmentation accuracy of modern-day convolutional neural networks (CNN) applied on cardiac MRI can reach the inter-expert variability, a great achievement in this area of research. However, despite these successes, CNNs still produce anatomically inaccurate segmentations as they provide no guarantee on the anatomical plausibility of their outcome, even when using a shape prior. In this paper, we propose a cardiac MRI segmentation method which always produces anatomically plausible results. At the core of the method is an adversarial variational autoencod…
We introduce a model-based reconstruction framework with deep learned (DL) and smoothness regularization on manifolds (STORM) priors to recover free breathing and ungated (FBU) cardiac MRI from highly undersampled measurements. The DL priors enable us to exploit the local correlations, while the STORM prior enables us to make use of the extensive non-local similarities that are subject dependent. We introduce a novel model-based formulation that allows the seamless integration of deep learning methods with available prior information, which current deep learning algorithms are not capable of. …
Automatic segmentation of myocardial contours and relevant areas like infraction and no-reflow is an important step for the quantitative evaluation of myocardial infarction. In this work, we propose a cascaded convolutional neural network for automatic myocardial infarction segmentation from delayed-enhancement cardiac MRI. We first use a 2D U-Net to focus on the intra-slice information to perform a preliminary segmentation. After that, we use a 3D U-Net to utilize the volumetric spatial information for a subtle segmentation. Our method is evaluated on the MICCAI 2020 EMIDEC challenge dataset …
Cardiac Magnetic Resonance Imaging (MRI) plays an important role in the analysis of cardiac function. However, the acquisition is often accompanied by motion artefacts because of the difficulty of breath-hold, especially for acute symptoms patients. Therefore, it is essential to assess the quality of cardiac MRI for further analysis. Time-consuming manual-based classification is not conducive to the construction of an end-to-end computer aided diagnostic system. To overcome this problem, an automatic cardiac MRI quality estimation framework using ensemble and transfer learning is proposed in t…
