Positron Emission Tomography (PET) is an imaging method that can assess physiological function rather than structural disturbances by measuring cerebral perfusion or glucose consumption. However, this imaging technique relies on injection of radioactive tracers and is expensive. On the contrary, Arterial Spin Labeling (ASL) MRI is a non-invasive, non-radioactive, and relatively cheap imaging technique for brain hemodynamic measurements, which allows quantification to some extent. In this paper we propose a convolutional neural network (CNN) based model for translating ASL to PET images, which could benefit patients as well as the healthcare system in terms of expenses and adverse side effects. However, acquiring a sufficient number of paired ASL-PET scans for training a CNN is prohibitive for many reasons. To tackle this problem, we present a new semi-supervised multitask CNN which is trained on both paired data, i.e. ASL and PET scans, and unpaired data, i.e. only ASL scans, which alleviates the problem of training a network on limited paired data. Moreover, we present a new residual-based-attention guided mechanism to improve the contextual features during the training process. Also, we show that incorporating T1-weighted scans as an input, due to its high resolution and availability of anatomical information, improves the results. We performed a two-stage evaluation based on quantitative image metrics by conducting a 7-fold cross validation followed by a double-blind observer study. The proposed network achieved structural similarity index measure (SSIM), mean squared error (MSE) and peak signal-to-noise ratio (PSNR) values of $0.85\pm0.08$, $0.01\pm0.01$, and $21.8\pm4.5$ respectively, for translating from 2D ASL and T1-weighted images to PET data. The proposed model is publicly available via https://github.com/yousefis/ASL2PET.
Stanford University(斯坦福大学);GE Healthcare(通用电气医疗集团);University of California Riverside(加州大学河滨分校);National Taiwan University(台湾大学)
Accurate quantification of cerebral blood flow (CBF) is essential for the diagnosis and assessment of cerebrovascular diseases such as Moyamoya, carotid stenosis, aneurysms, and stroke. Positron emission tomography (PET) is currently regarded as the gold standard for the measurement of CBF in the human brain. PET imaging, however, is not widely available because of its prohibitive costs, use of ionizing radiation, and logistical challenges, which require a co-localized cyclotron to deliver the 2 min half-life Oxygen-15 radioisotope. Magnetic resonance imaging (MRI), in contrast, is more readil…
CT to PET Translation: A Large-scale Dataset and Domain-Knowledge-Guided Diffusion Approach
Hanoi University of Science and Technology(河内科技大学);Military Central Hospital(108军事中央医院);VinUniversity;National Institute of Advanced Industrial Science and Technology(国立先进工业技术研究院)
2.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction
Yale School of Medicine(耶鲁医学院);University of California Irvine(加州大学欧文分校);Yale University(耶鲁大学)
Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin
Department of Computing Science, Umeå University(计算科学系,乌梅大学);Department of Diagnostics and Intervention, Biomedical Engineering and Radiation Physics, Umeå University(诊断与介入系,生物医学工程与放射物理,乌梅大学)
Indian Institute of Technology (IIT) Bombay(印度理工学院孟买分校);IITB-Monash Research Academy(印度理工学院孟买分校-莫纳什研究学院);Monash University(莫纳什大学)
Radiation exposure in positron emission tomography (PET) imaging limits its usage in the studies of radiation-sensitive populations, e.g., pregnant women, children, and adults that require longitudinal imaging. Reducing the PET radiotracer dose or acquisition time reduces photon counts, which can deteriorate image quality. Recent deep-neural-network (DNN) based methods for image-to-image translation enable the mapping of low-quality PET images (acquired using substantially reduced dose), coupled with the associated magnetic resonance imaging (MRI) images, to high-quality PET images. However, s…
University of Tübingen(图宾根大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Image-to-image translation plays a vital role in tackling various medical imaging tasks such as attenuation correction, motion correction, undersampled reconstruction, and denoising. Generative adversarial networks have been shown to achieve the state-of-the-art in generating high fidelity images for these tasks. However, the state-of-the-art GAN-based frameworks do not estimate the uncertainty in the predictions made by the network that is essential for making informed medical decisions and subsequent revision by medical experts and has recently been shown to improve the performance and inter…
IgCONDA-PET: Weakly-Supervised PET Anomaly Detection using Implicitly-Guided Attention-Conditional Counterfactual Diffusion Modeling -- a Multi-Center, Multi-Cancer, and Multi-Tracer Study
organization= Department of Physics \& Astronomy, University of British Columbia , city= Vancouver , state= BC , country= Canada;organization= Department of Integrative Oncology, BC Cancer Research Institute , city= Vancouver , state= BC , country= Canada;organization= Department of Radiology, University of British Columbia , city= Vancouver , state= BC , country= Canada
Positron Emission Tomography (PET) is an important tool for studying Alzheimer's disease (AD). PET scans can be used as diagnostics tools, and to provide molecular characterization of patients with cognitive disorders. However, multiple tracers are needed to measure glucose metabolism (18F-FDG), synaptic vesicle protein (11C-UCB-J), and $β$-amyloid (11C-PiB). Administering multiple tracers to patient will lead to high radiation dose and cost. In addition, access to PET scans using new or less-available tracers with sophisticated production methods and short half-life isotopes may be very limit…
Ambient-Pix2PixGAN for Translating Medical Images from Noisy Data
University of Michigan-Shanghai Jiao Tong University Joint Institute(密歇根大学-上海交通大学联合学院);Global Institute of Future Technology, Shanghai Jiao Tong University(上海交通大学未来技术全球研究院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院)
3D Wavelet Latent Diffusion Model for Whole-Body MR-to-CT Modality Translation
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);School of Information Science and Technology, ShanghaiTech University(上海交通大学信息科学与技术学院);Shanghai United Imaging Healthcare Co., Ltd.(上海联影医疗科技有限公司);Department of Radiology and Biomedical Imaging, Yale University(耶鲁大学放射科与生物医学成像系);Department of Applied Mathematics & Statistics and Department of Computer Science, Stony Brook University(石溪大学应用数学与统计系和计算机科学系)