In order to ensure trouble-free operation, prediction of hardware failures is essential. This applies especially to medical systems. Our goal is to determine hardware which needs to be exchanged before failing. In this work, we focus on predicting failures of 20-channel Head/Neck coils using image-related measurements. Thus, we aim to solve a classification problem with two classes, normal and broken coil. To solve this problem, we use data of two different levels. One level refers to one-dimensional features per individual coil channel on which we found a fully connected neural network to perform best. The other data level uses matrices which represent the overall coil condition and feeds a different neural network. We stack the predictions of those two networks and train a Random Forest classifier as the ensemble learner. Thus, combining insights of both trained models improves the prediction results and allows us to determine the coil's condition with an F-score of 94.14% and an accuracy of 99.09%.
Friedrich-Alexander University Erlangen-Nuremberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）
Already before systems malfunction one has to know if hardware components will fail in near future in order to counteract in time. Thus, unplanned downtime is ought to be avoided. In medical imaging, maximizing the system's uptime is crucial for patients' health and healthcare provider's daily business. We aim to predict failures of Head/Neck coils used in Magnetic Resonance Imaging (MRI) by training a statistical model on sequential data collected over time. As image features depend on the coil's condition, their deviations from the normal range already hint to future failure. Thus, we used i…
University of Notre Dame（圣母大学）；Guangdong Cardiovascular Institute（广东省心血管病研究所）；Guangdong Provincial People’s Hospital（广东省人民医院）；Boston Children’s Hospital（波士顿儿童医院）；Harvard Medical School（哈佛医学院）；University of Pittsburgh（匹兹堡大学）
Real-time cardiac magnetic resonance imaging (MRI) plays an increasingly important role in guiding various cardiac interventions. In order to provide better visual assistance, the cine MRI frames need to be segmented on-the-fly to avoid noticeable visual lag. In addition, considering reliability and patient data privacy, the computation is preferably done on local hardware. State-of-the-art MRI segmentation methods mostly focus on accuracy only, and can hardly be adopted for real-time application or on local hardware. In this work, we present the first hardware-aware multi-scale neural archite…
Amsterdam UMC, University of Amsterdam（阿姆斯特丹大学阿姆斯特丹大学医学中心）；Amsterdam University Medical Center, University of Amsterdam（阿姆斯特丹大学阿姆斯特丹大学医学中心）；University Medical Center Utrecht（乌得勒支大学医学中心）
Segmentation of cardiac anatomical structures in cardiac magnetic resonance images (CMRI) is a prerequisite for automatic diagnosis and prognosis of cardiovascular diseases. To increase robustness and performance of segmentation methods this study combines automatic segmentation and assessment of segmentation uncertainty in CMRI to detect image regions containing local segmentation failures. Three state-of-the-art convolutional neural networks (CNN) were trained to automatically segment cardiac anatomical structures and obtain two measures of predictive uncertainty: entropy and a measure deriv…
Magnetic resonance imaging (MRI) is a widely used medical imaging modality. However, due to the limitations in hardware, scan time, and throughput, it is often clinically challenging to obtain high-quality MR images. The super-resolution approach is potentially promising to improve MR image quality without any hardware upgrade. In this paper, we propose an ensemble learning and deep learning framework for MR image super-resolution. In our study, we first enlarged low resolution images using 5 commonly used super-resolution algorithms and obtained differentially enlarged image datasets with com…
Phase-contrast magnetic resonance imaging (MRI) provides time-resolved quantification of blood flow dynamics that can aid clinical diagnosis. Long in vivo scan times due to repeated three-dimensional (3D) volume sampling over cardiac phases and breathing cycles necessitate accelerated imaging techniques that leverage data correlations. Standard compressed sensing reconstruction methods require tuning of hyperparameters and are computationally expensive, which diminishes the potential reduction of examination times. We propose an efficient model-based deep neural reconstruction network and eval…
Cardiac Magnetic Resonance Imaging (CMR) is widely used since it can illustrate the structure and function of heart in a non-invasive and painless way. However, it is time-consuming and high-cost to acquire the high-quality scans due to the hardware limitation. To this end, we propose a novel end-to-end trainable network to solve CMR video super-resolution problem without the hardware upgrade and the scanning protocol modifications. We incorporate the cardiac knowledge into our model to assist in utilizing the temporal information. Specifically, we formulate the cardiac knowledge as the period…
ETH Zurich（苏黎世联邦理工学院）；Helmholtz Zentrum München（慕尼黑亥姆霍兹中心）；Swiss Institute for Bioinformatics (SIB)（瑞士生物信息学研究所）
Owing to its pristine soft-tissue contrast and high resolution, structural magnetic resonance imaging (MRI) is widely applied in neurology, making it a valuable data source for image-based machine learning (ML) and deep learning applications. The physical nature of MRI acquisition and reconstruction, however, causes variations in image intensity, resolution, and signal-to-noise ratio. Since ML models are sensitive to such variations, performance on out-of-distribution data, which is inherent to the setting of a deployed healthcare ML application, typically drops below acceptable levels. We pro…
Distribution-Aware Replay for Continual MRI Segmentation
Technical University of Darmstadt（达姆施塔特工业大学）；Stanford University（斯坦福大学）；The Hessian Center for Artificial Intelligence: hessian.AI（黑森人工智能中心（hessian.AI））
a Division of Medical Informatics, Department of Biomedical Engineering b Division of Statistics \& Machine Learning, Department of Computer；Information Science c Center for Social；Affective Neuroscience, Department of Biomedical；Clinical Sciences d Center for Medical Image Science；Visualization (CMIV) \ \" o ping University, Sweden
Using 3D CNNs on high resolution medical volumes is very computationally demanding, especially for large datasets like the UK Biobank which aims to scan 100,000 subjects. Here we demonstrate that using 2D CNNs on a few 2D projections (representing mean and standard deviation across axial, sagittal and coronal slices) of the 3D volumes leads to reasonable test accuracy when predicting the age from brain volumes. Using our approach, one training epoch with 20,324 subjects takes 20 - 50 seconds using a single GPU, which two orders of magnitude faster compared to a small 3D CNN. These results are …
Medical image segmentation has significantly benefitted thanks to deep learning architectures. Furthermore, semi-supervised learning (SSL) has recently been a growing trend for improving a model's overall performance by leveraging abundant unlabeled data. Moreover, learning multiple tasks within the same model further improves model generalizability. To generate smoother and accurate segmentation masks from 3D cardiac MR images, we present a Multi-task Cross-task learning consistency approach to enforce the correlation between the pixel-level (segmentation) and the geometric-level (distance ma…
Uppsala University（乌普萨拉大学）；Antaros Medical AB（安塔罗斯医疗公司）
Large-scale medical studies such as the UK Biobank examine thousands of volunteer participants with medical imaging techniques. Combined with the vast amount of collected metadata, anatomical information from these images has the potential for medical analyses at unprecedented scale. However, their evaluation often requires manual input and long processing times, limiting the amount of reference values for biomarkers and other measurements available for research. Recent approaches with convolutional neural networks for regression can perform these evaluations automatically. On magnetic resonan…
Objective: Concurrent excitation and acquisition in MRI is a method to acquire MRI signal from tissues with very short transverse relaxation time. Since transmit power is many orders of magnitude larger than receive signal, a weak coupling dominates the MR signal during CEA. Thus, appropriate decoupling between transmit and receive coils is required. In this study, two controllable decoupling designs are investigated for achieving isolation between coils. Methods: A modified version of isolation concept used in the full-duplex radios in communication systems is applied to acquire MRI signal us…
Gordon Center for Medical Imaging, Massachusetts General Hospital and Harvard Medical School（马萨诸塞总医院与哈佛医学院戈登医学影像中心）；Texas A&M University（德克萨斯A&M大学）；Texas A&M Institute of Data Science, Texas A&M University（德克萨斯A&M大学数据科学研究所）；Texas A&M University at Qatar（德克萨斯A&M大学卡塔尔分校）
Magnetic resonance imaging (MRI) is one of the noninvasive imaging modalities that can produce high-quality images. However, the scan procedure is relatively slow, which causes patient discomfort and motion artifacts in images. Accelerating MRI hardware is constrained by physical and physiological limitations. A popular alternative approach to accelerated MRI is to undersample the k-space data. While undersampling speeds up the scan procedure, it generates artifacts in the images, and advanced reconstruction algorithms are needed to produce artifact-free images. Recently deep learning has emer…
Image Sciences Institute, University Medical Center Utrecht（乌得勒支大学医学中心影像科学研究所）
Diffusion magnetic resonance imaging is a noninvasive imaging technique that can indirectly infer the microstructure of tissues and provide metrics which are subject to normal variability across subjects. Potentially abnormal values or features may yield essential information to support analysis of controls and patients cohorts, but subtle confounds affecting diffusion MRI, such as those due to difference in scanning protocols or hardware, can lead to systematic errors which could be mistaken for purely biologically driven variations amongst subjects. In this work, we propose a new harmonizati…
Universidad Técnica Particular de Loja（洛哈技术大学）；University of Waterloo（滑铁卢大学）；Universitat Politècnica de València（瓦伦西亚理工大学）；Consejo Superior de Investigaciones Científicas (CSIC)（西班牙国家研究委员会）
Medical brain image analysis is a necessary step in Computer Assisted /Aided Diagnosis (CAD) systems. Advancements in both hardware and software in the past few years have led to improved segmentation and classification of various diseases. In the present work, we review the published literature on systems and algorithms that allow for classification, identification, and detection of White Matter Hyperintensities (WMHs) of brain MRI images specifically in cases of ischemic stroke and demyelinating diseases. For the selection criteria, we used the bibliometric networks. Out of a total of 140 do…
Layer Selection in Feature-Based Losses Affects Image Quality and Microstructural Consistency in Deep Learning Super-Resolution of Brain Diffusion MRI
Institue for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf（应用医学信息学研究所，汉堡大学医学中心）；Institute of Computational Neuroscience, University Medical Center Hamburg-Eppendorf（计算神经科学研究所，汉堡大学医学中心）；Center for Biomedical Artificial Intelligence (bAIome), University Medical Center Hamburg-Eppendorf（生物医学人工智能中心（bAIome），汉堡大学医学中心）
Multi-modal Liver Segmentation and Fibrosis Staging Using Real-world MRI Images
Multiscale X-ray Imaging (MXI) Lab, Department of Mechanical Engineering, University College London（多尺度X射线成像实验室，机械工程系，伦敦大学学院）；Centre for Clinical Brain Sciences, University of Edinburgh（临床脑科学中心，爱丁堡大学）；MRC Weatherall Institute of Molecular Medicine, University of Oxford（MRC韦伯尔分子医学研究所，牛津大学）
Noise Level Adaptive Diffusion Model for Robust Reconstruction of Accelerated MRI
Shenzhen Technology University（深圳技术大学）；Medical Center Göttingen University（哥廷根大学医学中心）；The Chinese University of Hong Kong（香港中文大学）；Longgang Central Hospital of Shenzhen（深圳市龙岗中心医院）
Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Boston Children’s Hospital（波士顿儿童医院）；University of Cape Town Faculty of Health Sciences（开普敦大学健康科学学院）；Wayne State University School of Medicine（韦恩州立大学医学院）；MIT Computer Science and Artificial Intelligence Laboratory（麻省理工学院计算机科学与人工智能实验室）
Skullstripping is defined as the task of segmenting brain tissue from a full head magnetic resonance image~(MRI). It is a critical component in neuroimage processing pipelines. Downstream deformable registration and whole brain segmentation performance is highly dependent on accurate skullstripping. Skullstripping is an especially challenging task for infant~(age range 0--18 months) head MRI images due to the significant size and shape variability of the head and the brain in that age range. Infant brain tissue development also changes the $T_1$-weighted image contrast over time, making consis…
Optimizing k-space sampling trajectories is a promising yet challenging topic for fast magnetic resonance imaging (MRI). This work proposes to optimize a reconstruction method and sampling trajectories jointly concerning image reconstruction quality in a supervised learning manner. We parameterize trajectories with quadratic B-spline kernels to reduce the number of parameters and apply multi-scale optimization, which may help to avoid sub-optimal local minima. The algorithm includes an efficient non-Cartesian unrolled neural network-based reconstruction and an accurate approximation for backpr…
Along with rich health-related metadata, medical images have been acquired for over 40,000 male and female UK Biobank participants, aged 44-82, since 2014. Phenotypes derived from these images, such as measurements of body composition from MRI, can reveal new links between genetics, cardiovascular disease, and metabolic conditions. In this work, six measurements of body composition and adipose tissues were automatically estimated by image-based, deep regression with ResNet50 neural networks from neck-to-knee body MRI. Despite the potential for high speed and accuracy, these networks produce no…
A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation
University Hospitals Leuven（鲁汶大学医院）；Technical University Munich（慕尼黑工业大学）；University Hospital Zurich（苏黎世大学医院）；University of Zurich（苏黎世大学）；University College London（伦敦大学学院）；University Hospitals Tanta（坦塔大学医院）；Medical University of Vienna（维也纳医科大学）
Magnetic Resonance Imaging (MRI) has long been considered to be among "the gold standards" of diagnostic medical imaging. The long acquisition times, however, render MRI prone to motion artifacts, let alone their adverse contribution to the relative high costs of MRI examination. Over the last few decades, multiple studies have focused on the development of both physical and post-processing methods for accelerated acquisition of MRI scans. These two approaches, however, have so far been addressed separately. On the other hand, recent works in optical computational imaging have demonstrated gro…
Purpose: Recent developments in hardware design enable the use of Fast Field-Cycling (FFC) techniques in MRI to exploit the different relaxation rates at very low field strength, achieving novel contrast. The method opens new avenues for in vivo characterisations of pathologies but at the expense of longer acquisition times. To mitigate this we propose a model-based reconstruction method that fully exploits the high information redundancy offered by FFC methods. Methods: The proposed model-based approach utilizes joint spatial information from all fields by means of a Frobenius - total general…
University of Virginia（弗吉尼亚大学）；University of Virginia Health System（弗吉尼亚大学卫生系统）
Automated identification of myocardial scar from late gadolinium enhancement cardiac magnetic resonance images (LGE-CMR) is limited by image noise and artifacts such as those related to motion and partial volume effect. This paper presents a novel joint deep learning (JDL) framework that improves such tasks by utilizing simultaneously learned myocardium segmentations to eliminate negative effects from non-region-of-interest areas. In contrast to previous approaches treating scar detection and myocardium segmentation as separate or parallel tasks, our proposed method introduces a message passin…
Department of Electrical and Computer Engineering, Seoul National University（首尔国立大学电气与计算机工程系）；Department of Psychiatry, Brigham and Women's Hospital, Harvard Medical School（精神病学系，布里金医院，哈佛医学院）
GE Healthcare（通用电气医疗集团）；Umeå University（于默奥大学）；Erasmus MC Cancer Institute（伊拉斯谟医学中心癌症研究所）；Newcastle University（纽卡斯尔大学）；Newcastle upon Tyne Hospitals NHS Foundation Trust（泰恩河畔纽卡斯尔NHS基金会信托）；Technical University of Munich（慕尼黑工业大学）；Sree Chitra Tirunal Institute of Medical Sciences and Technology（斯里奇特拉蒂鲁纳尔医学科学与技术研究所）；University of Zurich（苏黎世大学）
In this work, we present a method for synthetic CT (sCT) generation from zero-echo-time (ZTE) MRI aimed at structural and quantitative accuracies of the image, with a particular focus on the accurate bone density value prediction. We propose a loss function that favors a spatially sparse region in the image. We harness the ability of a multi-task network to produce correlated outputs as a framework to enable localisation of region of interest (RoI) via classification, emphasize regression of values within RoI and still retain the overall accuracy via global regression. The network is optimized…
University College London（伦敦大学学院）；University of Ibadan（伊巴丹大学）；Great Ormond Street Hospital for Children（大奥蒙德街儿童医院）；UCL Great Ormond Street Institute of Child Health（伦敦大学学院大奥蒙德街儿童健康研究所）；King’s College London（伦敦国王学院）；Microsoft Research Cambridge（微软剑桥研究院）；Department of Radiology, College of Medicine, University of Ibadan, Nigeria（伊巴丹大学医学院放射科）；Department of Paediatrics, College of Medicine, University of Ibadan, Nigeria（伊巴丹大学医学院儿科）；Centre for Medical Image Computing and Department of Computer Science, University College London, UK（伦敦大学学院医学影像计算中心和计算机科学系）；Department of Biomedical Engineering, King’s College London, UK（伦敦国王学院生物医学工程系）；Machine Intelligence and Perception Group, Microsoft Research Cambridge, UK（微软剑桥研究院机器智能与感知组）
1.5T or 3T scanners are the current standard for clinical MRI, but low-field (<1T) scanners are still common in many lower- and middle-income countries for reasons of cost and robustness to power failures. Compared to modern high-field scanners, low-field scanners provide images with lower signal-to-noise ratio at equivalent resolution, leaving practitioners to compensate by using large slice thickness and incomplete spatial coverage. Furthermore, the contrast between different types of brain tissue may be substantially reduced even at equal signal-to-noise ratio, which limits diagnostic value…
