Deep Learning (DL) in neuroimaging has become increasingly relevant for detecting neurological conditions and neurodegenerative disorders. One of the most predominant biomarkers in neuroimaging is represented by brain age, which has been shown to be a good indicator for different conditions, such as Alzheimer's Disease. Using brain age for weakly supervised pre-training of DL models in transfer learning settings has also recently shown promising results, especially when dealing with data scarcity of different conditions. On the other hand, anatomical information of brain MRIs (e.g. cortical thickness) can provide important information for learning good representations that can be transferred to many downstream tasks. In this work, we propose AnatCL, an anatomical foundation model for brain MRIs that i.) leverages anatomical information in a weakly contrastive learning approach, and ii.) achieves state-of-the-art performances across many different downstream tasks. To validate our approach we consider 12 different downstream tasks for the diagnosis of different conditions such as Alzheimer's Disease, autism spectrum disorder, and schizophrenia. Furthermore, we also target the prediction of 10 different clinical assessment scores using structural MRI data. Our findings show that incorporating anatomical information during pre-training leads to more robust and generalizable representations. Pre-trained models can be found at: https://github.com/EIDOSLAB/AnatCL.
Metadata-Conditioned Generative Models to Synthesize Anatomically-Plausible 3D Brain MRIs
Stanford University（斯坦福大学）；University of Missouri（密苏里大学）；Missouri Institute of Mental Health（密苏里精神卫生研究所）；Weill Cornell Medicine（威尔康奈尔医学院）；SRI International（SRI国际研究所）
WASABI: A Metric for Evaluating Morphometric Plausibility of Synthetic Brain MRIs
Department of Radiology, Weill Cornell Medicine, New York, NY, USA（放射科，韦尔·科恩医学中心，纽约，纽约州，美国）；Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, USA（精神病学与行为科学系，斯坦福大学，斯坦福，加利福尼亚州，美国）；Department of Electrical and Computer Engineering, Cornell University, Ithaca, NY, USA（电气与计算机工程系，康奈尔大学，伊萨卡，纽约州，美国）
University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；Chung-Ang University（中央大学）
We present a method to segment MRI scans of the human brain into ischemic stroke lesion and normal tissues. We propose a neural network architecture in the form of a standard encoder-decoder where predictions are guided by a spatial expansion embedding network. Our embedding network learns features that can resolve detailed structures in the brain without the need for high-resolution training images, which are often unavailable and expensive to acquire. Alternatively, the encoder-decoder learns global structures by means of striding and max pooling. Our embedding network complements the encode…
Evaluation of 3D Counterfactual Brain MRI Generation
Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA Department of Radiology, Stanford University, Stanford, CA, USA Dept. of Psychiatry \& Behavioral Sciences, Stanford University, Stanford, CA, USA Department of Computer Science, Stanford University, Stanford, CA, USA Department of Bioengineering, Stanford University, Stanford, CA, USA Department of Electrical Engineering, Stanford University, Stanford, CA, USA
Brain Latent Progression: Individual-based Spatiotemporal Disease Progression on 3D Brain MRIs via Latent Diffusion
Dept. of Math and Computer Science, University of Catania（数学与计算机科学系，卡塔尼亚大学）；Centre for Medical Image Computing, University College London（医学影像计算中心，伦敦大学学院）；MIFT Department, University of Messina（MIFT系，梅斯ina大学）
提出 BrLP 时空模型，通过在小型潜在空间运行、整合受试者元数据与疾病动力学先验，并引入 LAS 算法，实现了 3D 脑部 MRI 个体化疾病进展的高精度预测。
Otto von Guericke University Magdeburg（马格德堡奥托·冯·格里克大学）；Center for Behavioral Brain Sciences（行为脑科学研究中心）；German Center for Neurodegenerative Disease（德国神经退行性疾病研究中心）
Expert interpretation of anatomical images of the human brain is the central part of neuro-radiology. Several machine learning-based techniques have been proposed to assist in the analysis process. However, the ML models typically need to be trained to perform a specific task, e.g., brain tumour segmentation or classification. Not only do the corresponding training data require laborious manual annotations, but a wide variety of abnormalities can be present in a human brain MRI - even more than one simultaneously, which renders representation of all possible anomalies very challenging. Hence, …
A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network
Children’s Hospital of Philadelphia（费城儿童医院）；Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）；National Cancer Institute（美国国家癌症研究所）；Children's National Hospital（儿童国家医院）；Sheikh Zayed Institute for Pediatric Surgical Innovation（谢赫扎耶德儿科外科创新研究院）
University of Oulu（奥卢大学）；KFUPM（法赫德国王石油与矿业大学）；King Fahd Specialist Hospital Dammam（达曼法赫德国王专科医院）
Introduction: Multiple Sclerosis (MS) is a chronic disease that affects millions of people across the globe. MS can critically affect different organs of the central nervous system such as the eyes, the spinal cord, and the brain. Background: To help physicians in diagnosing MS lesions, computer-aided methods are widely used. In this regard, a considerable research has been carried out in the area of automatic detection and segmentation of MS lesions in magnetic resonance images (MRIs). Methodology: In this study, we review the different approaches that have been used in computer-aided detecti…
Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology（汉堡工业大学医疗技术与智能系统研究所）；jung diagnostics GmbH（jung diagnostics GmbH公司）；Hamburg University of Technology（汉堡工业大学）
Lesion detection in brain Magnetic Resonance Images (MRIs) remains a challenging task. MRIs are typically read and interpreted by domain experts, which is a tedious and time-consuming process. Recently, unsupervised anomaly detection (UAD) in brain MRI with deep learning has shown promising results to provide a quick, initial assessment. So far, these methods only rely on the visual appearance of healthy brain anatomy for anomaly detection. Another biomarker for abnormal brain development is the deviation between the brain age and the chronological age, which is unexplored in combination with …
Comparison of different segmentation algorithms on brain volume and fractal dimension in infant brain MRIs
Laboratory for Motion Analysis, Devision of Paediatric Orthopaedic, Children's Hospital of Eastern Switzerland（东部瑞士儿童医院运动分析实验室）；Lucerne University of Applied Sciences and Arts（卢塞恩应用科学与艺术大学）；TOELT llc, Machine Learning Research and Development（TOELT公司，机器学习研究与开发）；University of Ljubljana, Faculty of Computer and Information Science（卢布尔雅那大学，计算机与信息科学学院）
We propose a novel framework for Alzheimer's disease (AD) detection using brain MRIs. The framework starts with a data augmentation method called Brain-Aware Replacements (BAR), which leverages a standard brain parcellation to replace medically-relevant 3D brain regions in an anchor MRI from a randomly picked MRI to create synthetic samples. Ground truth "hard" labels are also linearly mixed depending on the replacement ratio in order to create "soft" labels. BAR produces a great variety of realistic-looking synthetic MRIs with higher local variability compared to other mix-based methods, such…
School of Biomedical Engineering & Imaging Sciences, King’s College London, UK（伦敦国王学院生物医学工程与成像科学学院）；Department of Radiology, University Hospitals Leuven, Belgium（鲁汶大学医院放射科）；Institute for Women’s Health, University College London, UK（伦敦大学学院妇女健康研究所）；Department of Obstetrics and Gynaecology, University Hospitals Leuven, Belgium（鲁汶大学医院妇产科）；Department of Gynecology and Obstetrics, University Hospitals Tanta, Egypt（坦塔大学医院妇产科）；Department of Biomedical Imaging and Image-guided Therapy Medical University of Vienna, Austria（维也纳医科大学生物医学成像与图像引导治疗系）
The performance of deep neural networks typically increases with the number of training images. However, not all images have the same importance towards improved performance and robustness. In fetal brain MRI, abnormalities exacerbate the variability of the developing brain anatomy compared to non-pathological cases. A small number of abnormal cases, as is typically available in clinical datasets used for training, are unlikely to fairly represent the rich variability of abnormal developing brains. This leads machine learning systems trained by maximizing the average performance to be biased t…
Automated MRI Quality Assessment of Brain T1-weighted MRI in Clinical Data Warehouses: A Transfer Learning Approach Relying on Artefact Simulation
Sorbonne Université（索邦大学）；Institut du Cerveau – Paris Brain Institute - ICM（大脑研究所——巴黎脑研究所 - ICM）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；Inserm（法国国家健康与医学研究院）；AP-HP（巴黎公共医疗集团）；Hôpital de la Pitié-Salpêtrière（皮蒂-萨尔皮特里医院）
Automatic segmentation of brain abnormalities is challenging, as they vary considerably from one pathology to another. Current methods are supervised and require numerous annotated images for each pathology, a strenuous task. To tackle anatomical variability, Unsupervised Anomaly Detection (UAD) methods are proposed, detecting anomalies as outliers of a healthy model learned using a Variational Autoencoder (VAE). Previous work on UAD adopted a 2D approach, meaning that MRIs are processed as a collection of independent slices. Yet, it does not fully exploit the spatial information contained in …
MultiMAE for Brain MRIs: Robustness to Missing Inputs Using Multi-Modal Masked Autoencoder
Department of Radiation Oncology, TUM University Hospital, Munich, Germany（辐射肿瘤科，技术大学慕尼黑医院，慕尼黑，德国）；Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM)（医疗与医学人工智能教研室，技术大学慕尼黑（TUM））；TUM University Hospital, Munich, Germany（技术大学慕尼黑医院，慕尼黑，德国）；Chair for AI for Image-Guided Diagnosis and Therapy, Technical University of Munich (TUM)（图像引导诊断与治疗人工智能教研室，技术大学慕尼黑（TUM））；Munich Center for Machine Learning (MCML), Munich, Germany（慕尼黑机器学习中心（MCML），慕尼黑，德国）；Department of Computing, Imperial College London, London, UK（计算系，伦敦帝国学院，伦敦，英国）；Deutsches Konsortium für Translationale Krebsforschung (DKTK), Partner Site Munich, Munich, Germany（德国转化癌症研究联盟（DKTK），慕尼黑合作伙伴站点，慕尼黑，德国）；Institute of Radiation Medicine (IRM), Department of Radiation Sciences (DRS), Helmholtz Center Munich, Munich, Germany（辐射医学研究所（IRM），辐射科学部门（DRS），慕尼黑海德堡中心，慕尼黑，德国）
King’s College London（伦敦国王学院）；University Hospitals Leuven（鲁汶大学医院）；Technical University of Munich（慕尼黑工业大学）；University College London（伦敦大学学院）
This paper describes our method for our participation in the FeTA challenge2021 (team name: TRABIT). The performance of convolutional neural networks for medical image segmentation is thought to correlate positively with the number of training data. The FeTA challenge does not restrict participants to using only the provided training data but also allows for using other publicly available sources. Yet, open access fetal brain data remains limited. An advantageous strategy could thus be to expand the training data to cover broader perinatal brain imaging sources. Perinatal brain MRIs, other tha…
Effective, robust, and automatic tools for brain tumor segmentation are needed for the extraction of information useful in treatment planning from magnetic resonance (MR) images. Context-aware artificial intelligence is an emerging concept for the development of deep learning applications for computer-aided medical image analysis. In this work, it is investigated whether the addition of contextual information from the brain anatomy in the form of white matter, gray matter, and cerebrospinal fluid masks and probability maps improves U-Net-based brain tumor segmentation. The BraTS2020 dataset wa…
University of Ottawa（渥太华大学）；Children’s Hospital of Eastern Ontario（东安大略儿童医院）
Polymicrogyria (PMG) is a disorder of cortical organization mainly seen in children, which can be associated with seizures, developmental delay and motor weakness. PMG is typically diagnosed on magnetic resonance imaging (MRI) but some cases can be challenging to detect even for experienced radiologists. In this study, we create an open pediatric MRI dataset (PPMR) with PMG and controls from the Children's Hospital of Eastern Ontario (CHEO), Ottawa, Canada. The differences between PMG MRIs and control MRIs are subtle and the true distribution of the features of the disease is unknown. This mak…
Stanford University（斯坦福大学）；Stanford School of Medicine（斯坦福医学院）；University of California San Diego（加州大学圣地亚哥分校）；SRI International（斯坦福国际研究院）
Many neurological diseases are characterized by gradual deterioration of brain structure and function. Large longitudinal MRI datasets have revealed such deterioration, in part, by applying machine and deep learning to predict diagnosis. A popular approach is to apply Convolutional Neural Networks (CNN) to extract informative features from each visit of the longitudinal MRI and then use those features to classify each visit via Recurrent Neural Networks (RNNs). Such modeling neglects the progressive nature of the disease, which may result in clinically implausible classifications across visits…
A Dempster-Shafer approach to trustworthy AI with application to fetal brain MRI segmentation
University Hospitals Leuven（鲁汶大学医院）；Technical University Munich（慕尼黑工业大学）；University Hospital Zurich（苏黎世大学医院）；University of Zurich（苏黎世大学）；University College London（伦敦大学学院）；University Hospitals Tanta（坦塔大学医院）；Medical University of Vienna（维也纳医科大学）
GenFAR: A generalized representation of brain structure, derived from 49,246 multi-cohort MRIs via deep learning
University of Pennsylvania（宾夕法尼亚大学）；University of Melbourne（墨尔本大学）；University of Wisconsin School of Medicine and Public Health（威斯康星大学医学与公共卫生学院）；CSIRO Health and Biosecurity（联邦科学与工业研究组织健康与生物安全部）；CSIRO（联邦科学与工业研究组织）；University of California, San Francisco（加利福尼亚大学旧金山分校）；Washington University in St. Louis（圣路易斯华盛顿大学）；University of Washington（华盛顿大学）；Wake Forest School of Medicine（维克森林医学院）；Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Indiana University（印第安纳大学）；University of Southern California（南加利福尼亚大学）
Helmholtz-Zentrum Dresden-Rossendorf（亥姆霍兹德累斯顿罗森多夫研究中心）；University Hospital Carl Gustav Carus（卡尔·古斯塔夫·卡鲁斯大学医院）
Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the merging of anatomical and functional modalities for fast diagnosis of malignant tissues. In this paper, we present a novel end-to-end unsupervised learning-based Convolutional Neural Network (CNN) for fusing the high and low frequency components of MRI-PET grayscale image pairs, publicly available at ADNI, by exploiting Structural Similarity Index (SSIM) as the …
ContourDiff: Unpaired Medical Image Translation with Structural Consistency
Department of Electrical and Computer Engineering, Duke University（杜克大学电气与计算机工程系）；Department of Biostatistics & Bioinformatics, Duke University（杜克大学生物统计学与生物信息学系）；Department of Radiology, Duke University（杜克大学放射学系）；Department of Computer Science, Duke University（杜克大学计算机科学系）
Istituto Nazionale di Fisica Nucleare（意大利国家核物理研究所）；Università degli Studi di Bari（巴里大学）；INAF - Astronomical Observatory of Capodimonte（意大利国家天体物理研究所-卡波迪蒙特天文台）；Università degli Studi di Genova（热那亚大学）；Università degli Studi di Napoli Federico II（那不勒斯费德里克二世大学）；Istituto di Studi sui Sistemi Intelligenti per l’Automazione, CNR（意大利国家研究委员会智能系统与自动化研究所）
Neurodegenerative diseases are frequently associated with structural changes in the brain. Magnetic Resonance Imaging (MRI) scans can show these variations and therefore be used as a supportive feature for a number of neurodegenerative diseases. The hippocampus has been known to be a biomarker for Alzheimer disease and other neurological and psychiatric diseases. However, it requires accurate, robust and reproducible delineation of hippocampal structures. Fully automatic methods are usually the voxel based approach, for each voxel a number of local features were calculated. In this paper we co…
University College London（伦敦大学学院）；Biomediq A/S（Biomediq公司）；University of Copenhagen（哥本哈根大学）
Segmenting vascular pathologies such as white matter lesions in Brain magnetic resonance images (MRIs) require acquisition of multiple sequences such as T1-weighted (T1-w) --on which lesions appear hypointense-- and fluid attenuated inversion recovery (FLAIR) sequence --where lesions appear hyperintense--. However, most of the existing retrospective datasets do not consist of FLAIR sequences. Existing missing modality imputation methods separate the process of imputation, and the process of segmentation. In this paper, we propose a method to link both modality imputation and segmentation using…
Comparative Study of Anatomical and Learned Features in AI Models for Structural Brain MRI
Center for Data Science, New York University（纽约大学数据科学中心）；NYU Grossman School of Medicine（纽约大学格罗斯曼医学院）；Courant Institute of Mathematical Sciences, NYU（纽约大学柯朗数学科学研究所）
Anatomically Faithful Artifact Suppression in SENSE Accelerated Brain MRI
East China Normal University（华东师范大学）；Affiliated Hospital of Guizhou Medical University（贵州医科大学附属医院）；West China Hospital, Sichuan University（四川大学华西医院）；Chinese Academy of Medical Sciences（中国医学科学院）；RadioDynamic Medical（镭动医疗）；Lucile Packard Children’s Hospital（露西尔·帕卡德儿童医院）
Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology（汉堡工业大学医学技术与智能系统研究所）；jung diagnostics GmbH（jung diagnostics 有限公司）
Purpose. Brain Magnetic Resonance Images (MRIs) are essential for the diagnosis of neurological diseases. Recently, deep learning methods for unsupervised anomaly detection (UAD) have been proposed for the analysis of brain MRI. These methods rely on healthy brain MRIs and eliminate the requirement of pixel-wise annotated data compared to supervised deep learning. While a wide range of methods for UAD have been proposed, these methods are mostly 2D and only learn from MRI slices, disregarding that brain lesions are inherently 3D and the spatial context of MRI volumes remains unexploited. Metho…
Full-Head Segmentation of MRI with Abnormal Brain Anatomy: Model and Data Release
The City College of New York（纽约市立学院）；New York University（纽约大学）；Georgetown University（乔治城大学）；University of North Carolina School of Medicine（北卡罗来纳大学医学院）；Soterix Medical
BrainNormalizer: Anatomy-Informed Pseudo-Healthy Brain Reconstruction from Tumor MRI via Edge-Guided ControlNet
University of Pittsburgh（匹兹堡大学）；Georgia Institute of Technology（佐治亚理工学院）；University of Texas at Austin（德克萨斯大学奥斯汀分校）；Cedars-Sinai Medical Center（西德萨斯医疗中心）；Mayo Clinic Arizona（梅奥诊所亚利桑那分部）
Lausanne University Hospital and University of Lausanne（洛桑大学医院和洛桑大学）；Center for Biomedical Imaging（生物医学成像中心）；Ecole Polytechnique Fédérale de Lausanne（洛桑联邦理工学院）
A commonly adopted approach to carry out detection tasks in medical imaging is to rely on an initial segmentation. However, this approach strongly depends on voxel-wise annotations which are repetitive and time-consuming to draw for medical experts. An interesting alternative to voxel-wise masks are so-called "weak" labels: these can either be coarse or oversized annotations that are less precise, but noticeably faster to create. In this work, we address the task of brain aneurysm detection as a patch-wise binary classification with weak labels, in contrast to related studies that rather use s…
This work is an endeavor to develop a deep learning methodology for automated anatomical labeling of a given region of interest (ROI) in brain computed tomography (CT) scans. We combine both local and global context to obtain a representation of the ROI. We then use Relation Networks (RNs) to predict the corresponding anatomy of the ROI based on its relationship score for each class. Further, we propose a novel strategy employing nearest neighbors approach for training RNs. We train RNs to learn the relationship of the target ROI with the joint representation of its nearest neighbors in each c…
Enhancing Alzheimer's Diagnosis: Leveraging Anatomical Landmarks in Graph Convolutional Neural Networks on Tetrahedral Meshes
School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA（计算与增强智能学院，亚利桑那州立大学）；Amazon AGI, Redmond, WA, USA（亚马逊人工智慧部门）；Banner Alzheimer’s Institute, Phoenix, AZ, USA（贝纳尔德阿尔茨海默病研究所）
Community-Level Modeling of Gyral Folding Patterns for Robust and Anatomically Informed Individualized Brain Mapping
Department of Computer Science and Engineering, University of Texas at Arlington（计算机科学与工程系，德克萨斯大学阿灵顿分校）；School of Computing, University of Georgia（计算学院，佐治亚大学）；Department of Computer Science, Indiana University Indianapolis（计算机科学系，印第安纳大学印第安纳波利斯分校）
Image-based brain cancer prediction models, based on radiomics, quantify the radiologic phenotype from magnetic resonance imaging (MRI). However, these features are difficult to reproduce because of variability in acquisition and preprocessing pipelines. Despite evidence of intra-tumor phenotypic heterogeneity, the spatial diversity between different slices within an MRI scan has been relatively unexplored using such methods. In this work, we propose a deep anchor attention aggregation strategy with a Vision Transformer to predict survival risk for brain cancer patients. A Deep Anchor Attentio…
