Supervised reconstruction models are characteristically trained on matched pairs of undersampled and fully-sampled data to capture an MRI prior, along with supervision regarding the imaging operator to enforce data consistency. To reduce supervision requirements, the recent deep image prior framework instead conjoins untrained MRI priors with the imaging operator during inference. Yet, canonical convolutional architectures are suboptimal in capturing long-range relationships, and priors based on randomly initialized networks may yield suboptimal performance. To address these limitations, here we introduce a novel unsupervised MRI reconstruction method based on zero-Shot Learned Adversarial TransformERs (SLATER). SLATER embodies a deep adversarial network with cross-attention transformers to map noise and latent variables onto coil-combined MR images. During pre-training, this unconditional network learns a high-quality MRI prior in an unsupervised generative modeling task. During inference, a zero-shot reconstruction is then performed by incorporating the imaging operator and optimizing the prior to maximize consistency to undersampled data. Comprehensive experiments on brain MRI datasets clearly demonstrate the superior performance of SLATER against state-of-the-art unsupervised methods.
Parallel imaging is a widely-used technique to accelerate magnetic resonance imaging (MRI). However, current methods still perform poorly in reconstructing artifact-free MRI images from highly undersampled k-space data. Recently, implicit neural representation (INR) has emerged as a new deep learning paradigm for learning the internal continuity of an object. In this study, we adopted INR to parallel MRI reconstruction. The MRI image was modeled as a continuous function of spatial coordinates. This function was parameterized by a neural network and learned directly from the measured k-space it…
Automatic segmentation of brain abnormalities is challenging, as they vary considerably from one pathology to another. Current methods are supervised and require numerous annotated images for each pathology, a strenuous task. To tackle anatomical variability, Unsupervised Anomaly Detection (UAD) methods are proposed, detecting anomalies as outliers of a healthy model learned using a Variational Autoencoder (VAE). Previous work on UAD adopted a 2D approach, meaning that MRIs are processed as a collection of independent slices. Yet, it does not fully exploit the spatial information contained in …
TU Munich(慕尼黑工业大学);Klinikum rechts der Isar(伊萨尔河右岸医院);ETH Zurich(苏黎世联邦理工学院);Johns Hopkins University(约翰斯·霍普金斯大学)
Brain pathologies can vary greatly in size and shape, ranging from few pixels (i.e. MS lesions) to large, space-occupying tumors. Recently proposed Autoencoder-based methods for unsupervised anomaly segmentation in brain MRI have shown promising performance, but face difficulties in modeling distributions with high fidelity, which is crucial for accurate delineation of particularly small lesions. Here, similar to these previous works, we model the distribution of healthy brain MRI to localize pathologies from erroneous reconstructions. However, to achieve improved reconstruction fidelity at hi…
Sun Yat-sen University(中山大学);The Chinese University of Hong Kong(香港中文大学);Royal Brompton Hospital(皇家布朗普顿医院);Imperial College London(伦敦帝国理工学院)
The long acquisition time has limited the accessibility of magnetic resonance imaging (MRI) because it leads to patient discomfort and motion artifacts. Although several MRI techniques have been proposed to reduce the acquisition time, compressed sensing in magnetic resonance imaging (CS-MRI) enables fast acquisition without compromising SNR and resolution. However, existing CS-MRI methods suffer from the challenge of aliasing artifacts. This challenge results in the noise-like textures and missing the fine details, thus leading to unsatisfactory reconstruction performance. To tackle this chal…
Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology(汉堡工业大学医学技术与智能系统研究所);jung diagnostics GmbH(jung diagnostics 有限公司)
Purpose. Brain Magnetic Resonance Images (MRIs) are essential for the diagnosis of neurological diseases. Recently, deep learning methods for unsupervised anomaly detection (UAD) have been proposed for the analysis of brain MRI. These methods rely on healthy brain MRIs and eliminate the requirement of pixel-wise annotated data compared to supervised deep learning. While a wide range of methods for UAD have been proposed, these methods are mostly 2D and only learn from MRI slices, disregarding that brain lesions are inherently 3D and the spatial context of MRI volumes remains unexploited. Metho…
Medical Faculty Mannheim of Heidelberg University(海德堡大学曼海姆医学院)
Statistical analysis of magnetic resonance imaging (MRI) can help radiologists to detect pathologies that are otherwise likely to be missed. Deep learning (DL) has shown promise in modeling complex spatial data for brain anomaly detection. However, DL models have major deficiencies: they need large amounts of high-quality training data, are difficult to design and train and are sensitive to subtle changes in scanning protocols and hardware. Here, we show that also simple statistical methods such as voxel-wise (baseline and covariance) models and a linear projection method using spatial pattern…
Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology(汉堡工业大学医疗技术与智能系统研究所);jung diagnostics GmbH(jung diagnostics GmbH公司);Hamburg University of Technology(汉堡工业大学)
Lesion detection in brain Magnetic Resonance Images (MRIs) remains a challenging task. MRIs are typically read and interpreted by domain experts, which is a tedious and time-consuming process. Recently, unsupervised anomaly detection (UAD) in brain MRI with deep learning has shown promising results to provide a quick, initial assessment. So far, these methods only rely on the visual appearance of healthy brain anatomy for anomaly detection. Another biomarker for abnormal brain development is the deviation between the brain age and the chronological age, which is unexplored in combination with …
Harvard Medical School(哈佛医学院);Massachusetts General Hospital(麻省总医院);California Institute of Technology(加州理工学院);Massachusetts Institute of Technology(麻省理工学院)
In neuroimaging, MRI tissue properties characterize underlying neurobiology, provide quantitative biomarkers for neurological disease detection and analysis, and can be used to synthesize arbitrary MRI contrasts. Estimating tissue properties from a single scan session using a protocol available on all clinical scanners promises to reduce scan time and cost, enable quantitative analysis in routine clinical scans and provide scan-independent biomarkers of disease. However, existing tissue properties estimation methods - most often $\mathbf{T_1}$ relaxation, $\mathbf{T_2^*}$ relaxation, and proto…
Facebook AI Research(Facebook人工智能研究);Facebook New York(纽约Facebook);NYU Grossman School of Medicine(纽约大学格罗斯曼医学院);Department of Radiology(放射科)
MRI images reconstructed from sub-sampled Cartesian data using deep learning techniques often show a characteristic banding (sometimes described as streaking), which is particularly strong in low signal-to-noise regions of the reconstructed image. In this work, we propose the use of an adversarial loss that penalizes banding structures without requiring any human annotation. Our technique greatly reduces the appearance of banding, without requiring any additional computation or post-processing at reconstruction time. We report the results of a blind comparison against a strong baseline by a gr…
Université Côte d’Azur(蔚蓝海岸大学);Inria(法国国家信息与自动化研究所);William Harvey Research Institute(威廉·哈维研究所);Queen Mary University of London(伦敦玛丽女王大学);Barts Health NHS Trust(巴茨健康国民保健信托基金)
We perform unsupervised analysis of image-derived shape and motion features extracted from 3822 cardiac 4D MRIs of the UK Biobank. First, with a feature extraction method previously published based on deep learning models, we extract from each case 9 feature values characterizing both the cardiac shape and motion. Second, a feature selection is performed to remove highly correlated feature pairs. Third, clustering is carried out using a Gaussian mixture model on the selected features. After analysis, we identify two small clusters which probably correspond to two pathological categories. Furth…
Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院Martinos生物医学影像中心);Massachusetts Institute of Technology(麻省理工学院);Cornell University(康奈尔大学);University College London(伦敦大学学院)
Probabilistic atlas priors have been commonly used to derive adaptive and robust brain MRI segmentation algorithms. Widely-used neuroimage analysis pipelines rely heavily on these techniques, which are often computationally expensive. In contrast, there has been a recent surge of approaches that leverage deep learning to implement segmentation tools that are computationally efficient at test time. However, most of these strategies rely on learning from manually annotated images. These supervised deep learning methods are therefore sensitive to the intensity profiles in the training dataset. To…
Memorial Sloan Kettering Cancer Center(纪念斯隆-凯特琳癌症中心)
Our contribution is a unified cross-modality feature disentagling approach for multi-domain image translation and multiple organ segmentation. Using CT as the labeled source domain, our approach learns to segment multi-modal (T1-weighted and T2-weighted) MRI having no labeled data. Our approach uses a variational auto-encoder (VAE) to disentangle the image content from style. The VAE constrains the style feature encoding to match a universal prior (Gaussian) that is assumed to span the styles of all the source and target modalities. The extracted image style is converted into a latent style sc…
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Johns Hopkins University(约翰斯·霍普金斯大学);University of Maryland School of Dentistry(马里兰大学牙医学院)
Cycle reconstruction regularized adversarial training -- e.g., CycleGAN, DiscoGAN, and DualGAN -- has been widely used for image style transfer with unpaired training data. Several recent works, however, have shown that local distortions are frequent, and structural consistency cannot be guaranteed. Targeting this issue, prior works usually relied on additional segmentation or consistent feature extraction steps that are task-specific. To counter this, this work aims to learn a general add-on structural feature extractor, by explicitly enforcing the structural alignment between an input and it…
Accurate segmentation of breast lesions is a crucial step in evaluating the characteristics of tumors. However, this is a challenging task, since breast lesions have sophisticated shape, topological structure, and variation in the intensity distribution. In this paper, we evaluated the performance of three unsupervised algorithms for the task of breast Magnetic Resonance (MRI) lesion segmentation, namely, Gaussian Mixture Model clustering, K-means clustering and a marker-controlled Watershed transformation based method. All methods were applied on breast MRI slices following selection of regio…
Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院保罗·C·劳特伯生物医学成像研究中心);Research Center for Medical AI, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院医学人工智能研究中心);Shenzhen College of Advanced Technology, University of Chinese Academy of Sciences(中国科学院大学深圳先进技术学院);The State University of New York, Buffalo(纽约州立大学布法罗分校)
Deep learning has achieved good success in cardiac magnetic resonance imaging (MRI) reconstruction, in which convolutional neural networks (CNNs) learn a mapping from the undersampled k-space to the fully sampled images. Although these deep learning methods can improve the reconstruction quality compared with iterative methods without requiring complex parameter selection or lengthy reconstruction time, the following issues still need to be addressed: 1) all these methods are based on big data and require a large amount of fully sampled MRI data, which is always difficult to obtain for cardiac…
Convolutional neural networks (CNNs) have been applied to various automatic image segmentation tasks in medical image analysis, including brain MRI segmentation. Generative adversarial networks have recently gained popularity because of their power in generating images that are difficult to distinguish from real images. In this study we use an adversarial training approach to improve CNN-based brain MRI segmentation. To this end, we include an additional loss function that motivates the network to generate segmentations that are difficult to distinguish from manual segmentations. During traini…
Thomas Jefferson High School for Science and Technology(托马斯·杰斐逊科技高中)
Glioblastoma Multiforme (GBM) is a malignant brain cancer forming around 48% of al brain and Central Nervous System (CNS) cancers. It is estimated that annually over 13,000 deaths occur in the US due to GBM, making it crucial to have early diagnosis systems that can lead to predictable and effective treatment. The most common treatment after GBM diagnosis is chemotherapy, which works by sending rapidly dividing cells to apoptosis. However, this form of treatment is not effective when the MGMT promoter sequence is methylated, and instead leads to severe side effects decreasing patient survivabi…
Lesion detection in brain Magnetic Resonance Images (MRI) remains a challenging task. State-of-the-art approaches are mostly based on supervised learning making use of large annotated datasets. Human beings, on the other hand, even non-experts, can detect most abnormal lesions after seeing a handful of healthy brain images. Replicating this capability of using prior information on the appearance of healthy brain structure to detect lesions can help computers achieve human level abnormality detection, specifically reducing the need for numerous labeled examples and bettering generalization of p…
Primitive Representation Learning for Unsupervised Dynamic Contrast Enhanced MRI Reconstruction
Helmholtz Munich(亥姆霍兹慕尼黑);Technical University of Munich(慕尼黑工业大学);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School(哈佛医学院);Munich Center for Machine Learning(慕尼黑机器学习中心);Imperial College London(伦敦帝国理工学院);King’s College London(伦敦国王学院)
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);School of Information Science and Technology, ShanghaiTech University(上海交通大学信息科学与技术学院);School of Biomedical Engineering and the National Engineering Research Center of Advanced Magnetic Resonance Technologies for Diagnosis and Therapy (NERCAMRT), Shanghai Jiao Tong University(上海交通大学生物医学工程学院和先进磁共振诊断与治疗国家工程研究中心)
University of Iceland(冰岛大学);Landspitali - University Hospital(兰斯皮塔利大学医院);The Icelandic Heart Association(冰岛心脏协会);The Johns Hopkins University(约翰斯·霍普金斯大学)
Lesions that appear hyperintense in both Fluid Attenuated Inversion Recovery (FLAIR) and T2-weighted magnetic resonance images (MRIs) of the human brain are common in the brains of the elderly population and may be caused by ischemia or demyelination. Lesions are biomarkers for various neurodegenerative diseases, making accurate quantification of them important for both disease diagnosis and progression. Automatic lesion detection using supervised learning requires manually annotated images, which can often be impractical to acquire. Unsupervised lesion detection, on the other hand, does not r…
To deform or not: treatment-aware longitudinal registration for breast DCE-MRI during neoadjuvant chemotherapy via unsupervised keypoints detection
Radboud University Medical Centre(拉德堡德大学医学中心);The Netherlands Cancer Institute(荷兰癌症研究所);Macao Polytechnic University(澳门理工大学);Maastricht University Medical Centre(马斯特里赫特大学医学中心)
Shandong Normal University(山东师范大学);Western University(韦仕敦大学)
Simultaneous segmentation and detection of liver tumors (hemangioma and hepatocellular carcinoma (HCC)) by using multi-modality non-contrast magnetic resonance imaging (NCMRI) are crucial for the clinical diagnosis. However, it is still a challenging task due to: (1) the HCC information on NCMRI is invisible or insufficient makes extraction of liver tumors feature difficult; (2) diverse imaging characteristics in multi-modality NCMRI causes feature fusion and selection difficult; (3) no specific information between hemangioma and HCC on NCMRI cause liver tumors detection difficult. In this stu…
Otto von Guericke University Magdeburg(马格德堡奥托·冯·格里克大学);Center for Behavioral Brain Sciences(行为脑科学研究中心);German Center for Neurodegenerative Disease(德国神经退行性疾病研究中心)
Expert interpretation of anatomical images of the human brain is the central part of neuro-radiology. Several machine learning-based techniques have been proposed to assist in the analysis process. However, the ML models typically need to be trained to perform a specific task, e.g., brain tumour segmentation or classification. Not only do the corresponding training data require laborious manual annotations, but a wide variety of abnormalities can be present in a human brain MRI - even more than one simultaneously, which renders representation of all possible anomalies very challenging. Hence, …
Memorial Sloan Kettering Cancer Center(纪念斯隆-凯特琳癌症中心);Indian Institute of Technology, Madras(印度理工学院马德拉斯分校)
Purpose: Lesion segmentation in medical imaging is key to evaluating treatment response. We have recently shown that reinforcement learning can be applied to radiological images for lesion localization. Furthermore, we demonstrated that reinforcement learning addresses important limitations of supervised deep learning; namely, it can eliminate the requirement for large amounts of annotated training data and can provide valuable intuition lacking in supervised approaches. However, we did not address the fundamental task of lesion/structure-of-interest segmentation. Here we introduce a method co…
Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction
School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China(上海交通大学生物医学工程学院);School of Information Science and Technology, ShanghaiTech University, Shanghai, China(上海科技大学信息科学与技术学院);iHuman Institute, Shanghaitech University, Shanghai, China(上海科技大学iHuman研究所)
Korea Advanced Institute of Science and Technology(韩国科学技术院);Samsung Electronics(三星电子)
Anomaly detection in medical imaging is to distinguish the relevant biomarkers of diseases from those of normal tissues. Deep supervised learning methods have shown potentials in various detection tasks, but its performances would be limited in medical imaging fields where collecting annotated anomaly data is limited and labor-intensive. Therefore, unsupervised anomaly detection can be an effective tool for clinical practices, which uses only unlabeled normal images as training data. In this paper, we developed an unsupervised learning framework for pixel-wise anomaly detection in multi-contra…
Rutgers University(罗格斯大学);New York University School of Medicine(纽约大学医学院);NVIDIA(英伟达);SenseBrain;Shanghai AI Laboratory(上海人工智能实验室)
Cardiac tagging magnetic resonance imaging (t-MRI) is the gold standard for regional myocardium deformation and cardiac strain estimation. However, this technique has not been widely used in clinical diagnosis, as a result of the difficulty of motion tracking encountered with t-MRI images. In this paper, we propose a novel deep learning-based fully unsupervised method for in vivo motion tracking on t-MRI images. We first estimate the motion field (INF) between any two consecutive t-MRI frames by a bi-directional generative diffeomorphic registration neural network. Using this result, we then e…
Towards Label-Free Brain Tumor Segmentation: Unsupervised Learning with Multimodal MRI
Universitat Politècnica de Catalunya (UPC)(西班牙巴塞罗那理工大学);University College Dublin (UCD)(都柏林大学);Dublin City University (DCU)(都柏林城市大学);Insight Research Ireland Center For Data Analytics(爱尔兰数据分析研究中心)
The Johns Hopkins University School of Medicine(约翰斯·霍普金斯大学医学院);Sidney Kimmel Comprehensive Cancer Center(西德尼·金梅尔综合癌症中心);The Johns Hopkins University(约翰斯·霍普金斯大学)
The evaluation and treatment of acute cerebral ischemia requires a technique that can determine the total area of tissue at risk for infarction using diagnostic magnetic resonance imaging (MRI) sequences. Typical MRI data sets consist of T1- and T2-weighted imaging (T1WI, T2WI) along with advanced MRI parameters of diffusion-weighted imaging (DWI) and perfusion weighted imaging (PWI) methods. Each of these parameters has distinct radiological-pathological meaning. For example, DWI interrogates the movement of water in the tissue and PWI gives an estimate of the blood flow, both are critical me…
Mild traumatic brain injury is a growing public health problem with an estimated incidence of over 1.7 million people annually in US. Diagnosis is based on clinical history and symptoms, and accurate, concrete measures of injury are lacking. This work aims to directly use diffusion MR images obtained within one month of trauma to detect injury, by incorporating deep learning techniques. To overcome the challenge due to limited training data, we describe each brain region using the bag of word representation, which specifies the distribution of representative patch patterns. We apply a convolut…
Universidad San Francisco de Quito(旧金山基多大学);University of South Florida(南佛罗里达大学)
Deep learning models have obtained state-of-the-art results for medical image analysis. However, when these models are tested on an unseen domain there is a significant performance degradation. In this work, we present an unsupervised Cross-Modality Adversarial Domain Adaptation (C-MADA) framework for medical image segmentation. C-MADA implements an image- and feature-level adaptation method in a sequential manner. First, images from the source domain are translated to the target domain through an un-paired image-to-image adversarial translation with cycle-consistency loss. Then, a U-Net netwo…
Enhancing Implicit Neural Representations with Image Feature Embedding for Unsupervised Cardiac Cine MRI Reconstruction
Division of Image Processing, Department of Radiology, Leiden University Medical Center(莱顿大学医学中心放射科图像处理部);C.J. Gorter Center, Department of Radiology, Leiden University Medical Center(莱顿大学医学中心放射科C.J. 戈特中心);Cardio Vascular Imaging Group, Department of Radiology, Leiden University Medical Center(莱顿大学医学中心放射科心血管成像组);Philips Innovative Technologies(飞利浦创新技术公司)
Harmonizing Flows: Leveraging normalizing flows for unsupervised and source-free MRI harmonization
LIVIA;ÉTS;ILLS;McGill(麦吉尔大学);Mila;CNRS(法国国家科学研究中心);Université Paris-Saclay(巴黎萨克雷大学);CentraleSupelec(中央理工学院);CHU Sainte-Justine(圣贾斯汀大学医疗中心);University of Montreal(蒙特利尔大学);Murdoch Children’s Research Institute(默多克儿童研究所);Monash University(莫纳什大学);The University of Melbourne(墨尔本大学);The Royal Women’s Hospital(皇家妇女医院)
Unsupervised Anomaly Detection in Brain MRI via Disentangled Anatomy Learning
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, China.(自动化与智能感知学院,上海交通大学,中国);School of Computer Science, The University of Sydney, Sydney, Australia.(计算机科学学院,悉尼大学,澳大利亚);Department of Radiology, Renji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai, China.(放射科,仁济医院,医学院,上海交通大学,中国);Biomedical Engineering Department, Tulane University, New Orleans, USA.(生物医学工程系, Tulane 大学,美国新奥尔良)
Friedrich-Alexander-Universität(弗里德里希-亚历山大大学);Imperial College(帝国理工学院);National Heart & Lung Institute, Imperial College(帝国理工学院国家心肺研究所);Royal Brompton Hospital(皇家布朗普顿医院)
Deep learning approaches have shown promising performance for compressed sensing-based Magnetic Resonance Imaging. While deep neural networks trained with mean squared error (MSE) loss functions can achieve high peak signal to noise ratio, the reconstructed images are often blurry and lack sharp details, especially for higher undersampling rates. Recently, adversarial and perceptual loss functions have been shown to achieve more visually appealing results. However, it remains an open question how to (1) optimally combine these loss functions with the MSE loss function and (2) evaluate such a p…
Numerous factors could lead to partial deteriorations of medical images. For example, metallic implants will lead to localized perturbations in MRI scans. This will affect further post-processing tasks such as attenuation correction in PET/MRI or radiation therapy planning. In this work, we propose the inpainting of medical images via Generative Adversarial Networks (GANs). The proposed framework incorporates two patch-based discriminator networks with additional style and perceptual losses for the inpainting of missing information in realistically detailed and contextually consistent manner. …
The primary goal of this work is to study the effectiveness of an unsupervised domain adaptation approach for various applications such as binary classification and anomaly detection in the context of Alzheimer's disease (AD) detection for the OASIS datasets. We also explore image reconstruction and image synthesis for analyzing and generating 3D structural MRI data to establish performance benchmarks for anomaly detection. We successfully demonstrate that domain adaptation improves the performance of AD detection when implemented in both supervised and unsupervised settings. Additionally, the…
LPIXEL Inc.(LPIXEL公司);University of Cambridge(剑桥大学);National Institute of Informatics(国立信息学研究所);National Center for Global Health and Medicine(国立国际医疗研究中心);Juntendo University(顺天堂大学);ELTE Eötvös Loránd University(厄特沃什·罗兰大学);The University of Tokyo(东京大学)
Unsupervised learning can discover various unseen abnormalities, relying on large-scale unannotated medical images of healthy subjects. Towards this, unsupervised methods reconstruct a 2D/3D single medical image to detect outliers either in the learned feature space or from high reconstruction loss. However, without considering continuity between multiple adjacent slices, they cannot directly discriminate diseases composed of the accumulation of subtle anatomical anomalies, such as Alzheimer's Disease (AD). Moreover, no study has shown how unsupervised anomaly detection is associated with eith…
The k-space data generated from magnetic resonance imaging (MRI) is only a finite sampling of underlying signals. Therefore, MRI images often suffer from low spatial resolution and Gibbs ringing artifacts. Previous studies tackled these two problems separately, where super resolution methods tend to enhance Gibbs artifacts, whereas Gibbs ringing removal methods tend to blur the images. It is also a challenge that high resolution ground truth is hard to obtain in clinical MRI. In this paper, we propose an unsupervised learning framework for both MRI super resolution and Gibbs artifacts removal …
Indian Institute of Technology, Madras(马德拉斯印度理工学院);Healthcare Technology Innovation Centre, IIT Madras(印度理工学院马德拉斯分校医疗技术创新中心)
Anomaly detection in MRI is of high clinical value in imaging and diagnosis. Unsupervised methods for anomaly detection provide interesting formulations based on reconstruction or latent embedding, offering a way to observe properties related to factorization. We study four existing modeling methods, and report our empirical observations using simple data science tools, to seek outcomes from the perspective of factorization as it would be most relevant to the task of unsupervised anomaly detection, considering the case of brain structural MRI. Our study indicates that anomaly detection algorit…
Compressive sensing magnetic resonance imaging (CS-MRI) accelerates the acquisition of MR images by breaking the Nyquist sampling limit. In this work, a novel generative adversarial network (GAN) based framework for CS-MRI reconstruction is proposed. Leveraging a combination of patch-based discriminator and structural similarity index based loss, our model focuses on preserving high frequency content as well as fine textural details in the reconstructed image. Dense and residual connections have been incorporated in a U-net based generator architecture to allow easier transfer of information a…
Simulating Dynamic Tumor Contrast Enhancement in Breast MRI using Conditional Generative Adversarial Networks
Barcelona Artificial Intelligence in Medicine Lab (BCN-AIM)(巴塞罗那人工智能医学实验室);Departament de Matemàtiques i Informàtica, Universitat de Barcelona(巴塞罗那大学数学与计算机科学系);Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich(生物医学成像机器学习研究所,海德堡慕尼黑);School of Computation, Information and Technology, Technical University of Munich(慕尼黑技术大学计算、信息与技术学院);Department of Oncology-Pathology, Karolinska Institutet(卡罗林斯卡研究所肿瘤-病理学系);School of Biomedical Engineering & Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与成像科学学院)
Politecnico di Milano(米兰理工大学);University of Twente(特温特大学);University of Bath(巴斯大学);University of Cambridge(剑桥大学)
4D flow MRI is a non-invasive imaging method that can measure blood flow velocities over time. However, the velocity fields detected by this technique have limitations due to low resolution and measurement noise. Coordinate-based neural networks have been researched to improve accuracy, with SIRENs being suitable for super-resolution tasks. Our study investigates SIRENs for time-varying 3-directional velocity fields measured in the aorta by 4D flow MRI, achieving denoising and super-resolution. We trained our method on voxel coordinates and benchmarked our approach using synthetic measurements…
Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院);Seoul National University College of Medicine(首尔大学医学院)
Diffusion-weighted MRI is nowadays performed routinely due to its prognostic ability, yet the quality of the scans are often unsatisfactory which can subsequently hamper the clinical utility. To overcome the limitations, here we propose a fully unsupervised quality enhancement scheme, which boosts the resolution and removes the motion artifact simultaneously. This process is done by first training the network using optimal transport driven cycleGAN with stochastic degradation block which learns to remove aliasing artifacts and enhance the resolution, then using the trained network in the test …