In this work, an image translation model is implemented to produce synthetic amyloid-beta PET images from structural MRI that are quantitatively accurate. Image pairs of amyloid-beta PET and structural MRI were used to train the model. We found that the synthetic PET images could be produced with a high degree of similarity to truth in terms of shape, contrast and overall high SSIM and PSNR. This work demonstrates that performing structural to quantitative image translation is feasible to enable the access amyloid-beta information from only MRI.
Generative artificial intelligence in ophthalmology: multimodal retinal images for the diagnosis of Alzheimer's disease with convolutional neural networks
Modality Contribution Score - A Per-Patient Framework for Quantifying the Relative Diagnostic Contribution of Structural MRI and Amyloid PET in Alzheimer's Disease
Taipei Medical University（台北医学大学）；University of Memphis（孟菲斯大学）；Chitkara University（奇特卡拉大学）；University College London（伦敦大学学院）；UPES（石油与能源研究大学）；University of Eastern Finland（东芬兰大学）；CNRS（法国国家科学研究中心）；University Bordeaux（波尔多大学）；Bordeaux INP（波尔多国立理工学院）
When Brains Disagree: Biological Ambiguity Underlies the Challenge of Amyloid PET Synthesis from Structural MRI
Hawkes Institute, University College London, UK（霍克斯研究所，伦敦大学学院，英国）；Department of Medical Physics and Biomedical Engineering, University College London, UK（医学物理与生物医学工程系，伦敦大学学院，英国）；AINOSTICS Ltd, Manchester, UK（AINOSTICS有限公司，曼彻斯特，英国）；Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, UK（痴呆研究中心，伦敦大学学院女王广场神经科学研究所，英国）；UK Dementia Research Institute, London, UK（英国痴呆研究研究所，伦敦，英国）；Department of Computer Science, University College London, UK（计算机科学系，伦敦大学学院，英国）
In recent days, Convolutional Neural Networks (CNN) have demonstrated impressive performance in medical image analysis. However, there is a lack of clear understanding of why and how the Convolutional Neural Network performs so well for image analysis task. How CNN analyzes an image and discriminates among samples of different classes are usually considered as non-transparent. As a result, it becomes difficult to apply CNN based approaches in clinical procedures and automated disease diagnosis systems. In this paper, we consider this issue and work on visualizing and understanding the decision…
Language-Enhanced Generative Modeling for Amyloid PET Synthesis from MRI and Blood Biomarkers
organization= Shanghai Artificial Intelligence Laboratory , city= Shanghai , postcode= 200082 , country= China；organization= School of Medicine, Xiamen University , city= Xiamen , state= Fujian , country= China；organization= Department of Nuclear Medicine \& PET Center, Huashan Hospital, Fudan University , city= Shanghai , country= China；organization= Department of Gerontology, Shanghai Jiao Tong University Affiliated Sixth People’s Hospital , city= Shanghai , country= China；organization= Department of Computer Science, Rutgers University , city= New Brunswick , state= New Jersey , country= United States；organization= Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences , city= Shenzhen , country= China
Recent studies suggest that combined analysis of Magnetic resonance imaging~(MRI) that measures brain atrophy and positron emission tomography~(PET) that quantifies hypo-metabolism provides improved accuracy in diagnosing Alzheimer's disease. However, such techniques are limited by the availability of corresponding scans of each modality. Current work focuses on a cross-modal approach to estimate FDG-PET scans for the given MR scans using a 3D U-Net architecture. The use of the complete MR image instead of a local patch based approach helps in capturing non-local and non-linear correlations be…
Technical University Munich（慕尼黑工业大学）；Ludwig Maximilians University Munich（慕尼黑大学）；Johns Hopkins University（约翰斯·霍普金斯大学）
Alzheimer's disease (AD) is the most common cause of dementia. An early detection is crucial for slowing down the disease and mitigating risks related to the progression. While the combination of MRI and FDG-PET is the best image-based tool for diagnosis, FDG-PET is not always available. The reliable detection of Alzheimer's disease with only MRI could be beneficial, especially in regions where FDG-PET might not be affordable for all patients. To this end, we propose a multi-task method based on U-Net that takes T1-weighted MR images as an input to generate synthetic FDG-PET images and classif…
The Positron Emission Tomography (PET) scan image requires expertise in the segmentation where clustering algorithm plays an important role in the automation process. The algorithm optimization is concluded based on the performance, quality and number of clusters extracted. This paper is proposed to study the commonly used K Means clustering algorithm and to discuss a brief list of toolboxes for reproducing and extending works presented in medical image analysis. This work is compiled using AForge .NET framework in windows environment and MATrix LABoratory (MATLAB 7.0.1)
Collaborative Attention and Consistent-Guided Fusion of MRI and PET for Alzheimer's Disease Diagnosis
School of Software Yunnan University（软件学院 云南大学）；Department of Computer Science The University of Sheffield（计算机科学系 剑桥大学）；Department of Computing Xian JiaoTong-Liverpool University（计算系 西交利物浦大学）
A robust multi-domain network for short-scanning amyloid PET reconstruction
National Institute for Mathematical Sciences（数学科学国家研究院）；Department of Nuclear Medicine, Dong-A University Hospital（东阿大学医院核医学系）；College of Medicine, Dong-A University（东阿大学医学院）
Lomonosov Moscow State University（莫斯科国立大学）；University of Bordeaux（波尔多大学）；Université Ibn Zhor（伊本·佐尔大学）；University Victor Segalen Bordeaux 2（维克多·瑟加兰-波尔多第二大学）
Computer-aided early diagnosis of Alzheimers Disease (AD) and its prodromal form, Mild Cognitive Impairment (MCI), has been the subject of extensive research in recent years. Some recent studies have shown promising results in the AD and MCI determination using structural and functional Magnetic Resonance Imaging (sMRI, fMRI), Positron Emission Tomography (PET) and Diffusion Tensor Imaging (DTI) modalities. Furthermore, fusion of imaging modalities in a supervised machine learning framework has shown promising direction of research. In this paper we first review major trends in automatic class…
Lomonosov Moscow State University（罗蒙诺索夫莫斯科国立大学）；University of Bordeaux（波尔多大学）；University Ibn Zhor（伊本·祖赫尔大学）；EPHE（法国高等研究实践学院）；PSL（巴黎文理研究大学）
In the last decade, computer-aided early diagnostics of Alzheimer's Disease (AD) and its prodromal form, Mild Cognitive Impairment (MCI), has been the subject of extensive research. Some recent studies have shown promising results in the AD and MCI determination using structural and functional Magnetic Resonance Imaging (sMRI, fMRI), Positron Emission Tomography (PET) and Diffusion Tensor Imaging (DTI) modalities. Furthermore, fusion of imaging modalities in a supervised machine learning framework has shown promising direction of research. In this paper we first review major trends in automati…
Enhancing Alzheimer's Diagnosis: Leveraging Anatomical Landmarks in Graph Convolutional Neural Networks on Tetrahedral Meshes
School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA（计算与增强智能学院，亚利桑那州立大学）；Amazon AGI, Redmond, WA, USA（亚马逊人工智慧部门）；Banner Alzheimer’s Institute, Phoenix, AZ, USA（贝纳尔德阿尔茨海默病研究所）
A Generalizable Feature Extractor for Alzheimer's-Related Brain MRI Tasks
McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University（麦吉尔大学蒙特利尔神经学研究所麦康奈尔脑成像中心）；Department of Biomedical Engineering, McGill University（麦吉尔大学生物医学工程系）
A Segmentation Framework for Accurate Diagnosis of Amyloid Positivity without Structural Images
Northwest Agricultural and Forestry Science and Technology University（西北农业和林业科学与技术大学）；Liaoning Province Shiyan High School（辽宁省石yan高级中学）；Northeast Yucai School（东北育才学校）；Northeast Yucai Foreign Language School（东北育才外国语学校）
NVIDIA Corporation（英伟达公司）；Seoul National University（首尔大学）
Positron Emission Tomography (PET) is now regarded as the gold standard for the diagnosis of Alzheimer's Disease (AD). However, PET imaging can be prohibitive in terms of cost and planning, and is also among the imaging techniques with the highest dosage of radiation. Magnetic Resonance Imaging (MRI), in contrast, is more widely available and provides more flexibility when setting the desired image resolution. Unfortunately, the diagnosis of AD using MRI is difficult due to the very subtle physiological differences between healthy and AD subjects visible on MRI. As a result, many attempts have…
Yuanpei College Peking University（北京大学元培学院）；Massachusetts General Hospital（麻省总医院）；College of Computer Science Zhejiang University（浙江大学计算机学院）
Imaging-based early diagnosis of Alzheimer Disease (AD) has become an effective approach, especially by using nuclear medicine imaging techniques such as Positron Emission Topography (PET). In various literature it has been found that PET images can be better modeled as signals (e.g. uptake of florbetapir) defined on a network (non-Euclidean) structure which is governed by its underlying graph patterns of pathological progression and metabolic connectivity. In order to effectively apply deep learning framework for PET image analysis to overcome its limitation on Euclidean grid, we develop a so…
Positron Emission Tomography (PET) is an important tool for studying Alzheimer's disease (AD). PET scans can be used as diagnostics tools, and to provide molecular characterization of patients with cognitive disorders. However, multiple tracers are needed to measure glucose metabolism (18F-FDG), synaptic vesicle protein (11C-UCB-J), and $β$-amyloid (11C-PiB). Administering multiple tracers to patient will lead to high radiation dose and cost. In addition, access to PET scans using new or less-available tracers with sophisticated production methods and short half-life isotopes may be very limit…
Lab for Artificial Intelligence in Medical Imaging (AI-Med), KJP, LMU Klinikum（慕尼黑大学附属医院儿童与青少年精神病学系医学影像人工智能实验室）；Technical University of Munich, School of Medicine（慕尼黑工业大学医学院）
Alzheimer's Disease (AD) is the most common form of dementia and often difficult to diagnose due to the multifactorial etiology of dementia. Recent works on neuroimaging-based computer-aided diagnosis with deep neural networks (DNNs) showed that fusing structural magnetic resonance images (sMRI) and fluorodeoxyglucose positron emission tomography (FDG-PET) leads to improved accuracy in a study population of healthy controls and subjects with AD. However, this result conflicts with the established clinical knowledge that FDG-PET better captures AD-specific pathologies than sMRI. Therefore, we p…
Shanghai University（上海大学）；Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences（中国科学院苏州生物医学工程技术研究所）；University of Science and Technology of China（中国科学技术大学）；Nanjing Medical University（南京医科大学）；The University of Electronic Science and Technology of China（电子科技大学）
FDG-PET reveals altered brain metabolism in individuals with mild cognitive impairment (MCI) and Alzheimer's disease (AD). Some biomarkers derived from FDG-PET by computer-aided-diagnosis (CAD) technologies have been proved that they can accurately diagnosis normal control (NC), MCI, and AD. However, the studies of identification of early MCI (EMCI) and late MCI (LMCI) with FDG-PET images are still insufficient. Compared with studies based on fMRI and DTI images, the researches of the inter-region representation features in FDG-PET images are insufficient. Moreover, considering the variability…
Lehigh University（里海大学）；University of Pennsylvania（宾夕法尼亚大学）
Identification of brain regions related to the specific neurological disorders are of great importance for biomarker and diagnostic studies. In this paper, we propose an interpretable Graph Convolutional Network (GCN) framework for the identification and classification of Alzheimer's disease (AD) using multi-modality brain imaging data. Specifically, we extended the Gradient Class Activation Mapping (Grad-CAM) technique to quantify the most discriminative features identified by GCN from brain connectivity patterns. We then utilized them to find signature regions of interest (ROIs) by detecting…
Graph Theory and GNNs to Unravel the Topographical Organization of Brain Lesions in Variants of Alzheimer's Disease Progression
Sorbonne Université（索邦大学）；Paris Brain Institute - ICM（巴黎脑研究所 - ICM）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；Inserm（法国国家健康与医学研究院）；AP-HP（巴黎公共医疗集团）；Hôpital de la Pitié Salpêtrière（皮蒂-萨尔皮特里耶医院）
Flexible Multimodal Neuroimaging Fusion for Alzheimer's Disease Progression Prediction
Department of Computer Science and Engineering（计算机科学与工程系）；Department of Biomedical Informatics（生物医学信息学系）；Department of Neurology（神经病学系）；Translational Data Analytics Institute（转化数据分析研究所）
MCR-VQGAN: A Scalable and Cost-Effective Tau PET Synthesis Approach for Alzheimer's Disease Imaging
Department of Biomedical Engineering, Wake Forest University School of Medicine（生物医学工程系，威克森林大学医学院）；Department of Radiology, Wake Forest School of Medicine（放射学系，威克森林医学院）；Department of Radiology and Biomedical Imaging, Yale School of Medicine（放射学与生物医学成像系，耶鲁医学院）
Multi-modal Graph Neural Network for Early Diagnosis of Alzheimer's Disease from sMRI and PET Scans
College of Electronics and Information Engineering, Sichuan University（四川大学电子信息工程学院）；School of Computer Science and Engineering, Nanyang Technological University（南洋理工大学计算机科学与工程学院）
University of Pennsylvania（宾夕法尼亚大学）；University of Texas San Antonio Health Science Center（德克萨斯大学圣安东尼奥健康科学中心）；National Institute on Aging（美国国家老龄化研究所）
Heterogeneity of brain diseases is a challenge for precision diagnosis/prognosis. We describe and validate Smile-GAN (SeMI-supervised cLustEring-Generative Adversarial Network), a novel semi-supervised deep-clustering method, which dissects neuroanatomical heterogeneity, enabling identification of disease subtypes via their imaging signatures relative to controls. When applied to MRIs (2 studies; 2,832 participants; 8,146 scans) including cognitively normal individuals and those with cognitive impairment and dementia, Smile-GAN identified 4 neurodegenerative patterns/axes: P1, normal anatomy a…
University of Pennsylvania（宾夕法尼亚大学）；Lund University（隆德大学）
Volume change measures derived from longitudinal MRI (e.g. hippocampal atrophy) are a well-studied biomarker of disease progression in Alzheimer's Disease (AD) and are used in clinical trials to track the therapeutic efficacy of disease-modifying treatments. However, longitudinal MRI change measures can be confounded by non-biological factors, such as different degrees of head motion and susceptibility artifact between pairs of MRI scans. We hypothesize that deep learning methods applied directly to pairs of longitudinal MRI scans can be trained to differentiate between biological changes and …
Background and Purpose: Altered brain vasculature is a key phenomenon in several neurologic disorders. This paper presents a quantitative assessment of vascular morphology in healthy and diseased adults including changes during aging and the anatomical variations in the Circle of Willis (CoW). Methods: We used our automatic method to segment and extract novel geometric features of the cerebral vasculature from MRA scans of 175 healthy subjects, 45 AIS, and 50 AD patients after spatial registration. This is followed by quantification and statistical analysis of vascular alterations in acute isc…
