Purpose: Neural network image reconstruction directly from measurement data is a relatively new field of research, that until now has been limited to producing small single-slice images (e.g., 1x128x128). This paper proposes a novel and more efficient network design for Positron Emission Tomography called DirectPET which is capable of reconstructing multi-slice image volumes (i.e., 16x400x400) from sinograms.
Approach: Large-scale direct neural network reconstruction is accomplished by addressing the associated memory space challenge through the introduction of a specially designed Radon inversion layer. Using patient data, we compare the proposed method to the benchmark Ordered Subsets Expectation Maximization (OSEM) algorithm using signal-to-noise ratio, bias, mean absolute error and structural similarity measures. In addition, line profiles and full-width half-maximum measurements are provided for a sample of lesions.
Results: DirectPET is shown capable of producing images that are quantitatively and qualitatively similar to the OSEM target images in a fraction of the time. We also report on an experiment where DirectPET is trained to map low count raw data to normal count target images demonstrating the method's ability to maintain image quality under a low dose scenario.
Conclusion: The ability of DirectPET to quickly reconstruct high-quality, multi-slice image volumes suggests potential clinical viability of the method. However, design parameters and performance boundaries need to be fully established before adoption can be considered.
Positron emission tomography (PET) scanners continue to increase sensitivity and axial coverage by adding an ever expanding array of block detectors. As they age, one or more block detectors may lose sensitivity due to a malfunction or component failure. The sinogram data missing as a result thereof can lead to artifacts and other image degradations. We propose to mitigate the effects of malfunctioning block detectors by carrying out sinogram repair using a deep convolutional neural network. Experiments using whole-body patient studies with varying amounts of raw data removed are used to show …
Filling of incomplete sinograms from sparse PET detector configurations using a residual U-Net
Department of Mathematics and Mathematical Statistics, Umeå University(数学与统计学系,乌梅大学);Department of Mathematical Sciences, University of Copenhagen(数学科学系,哥本哈根大学);Norsk Regnesentral, Oslo(奥斯陆挪威计算中心);UiT Machine Learning Group, Department of Physics and Technology, UiT The Arctic University of Norway(UiT机器学习组,物理与技术系,UiT北极大学);The PET Imaging Center, University Hospital of North Norway(北挪威大学医院PET成像中心);Nuclear Medicine and Radiation Biology Research Group, Department of Clinical Medicine, UiT The Arctic University of Norway(核医学与辐射生物学研究组,临床医学系,UiT北极大学);Department of Diagnostics and Intervention, Oncology, Umeå University(诊断与介入系,肿瘤学,乌梅大学);Department of Diagnostics and Intervention, Radiation Physics, Umeå University(诊断与介入系,辐射物理学,乌梅大学)
TriDo-Former: A Triple-Domain Transformer for Direct PET Reconstruction from Low-Dose Sinograms
School of Computer Science, Sichuan University(四川大学计算机学院);School of Computer Science, Chengdu University of Information Technology(成都信息工程大学计算机学院);School of Biomedical Engineering, ShanghaiTech University(上海科技大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司)
End-to-end Triple-domain PET Enhancement: A Hybrid Denoising-and-reconstruction Framework for Reconstructing Standard-dose PET Images from Low-dose PET Sinograms
ShanghaiTech University(上海科技大学);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
提出端到端三域 TriPLET 框架,融合投影域去噪、小波域重建和图像域对抗评估,从低剂量 PET 正弦图恢复标准剂量图像,并取得最优相似度与信噪比。
End-to-End PET Image Reconstruction via a Posterior-Mean Diffusion Model
Department of Electrical and Computer Engineering, Rice University, Houston, USA(电气与计算机工程系,里士大学,美国休斯顿);Department of Imaging Physics, University of Texas MD Anderson Cancer Center, Houston, USA(影像物理系,德克萨斯大学MD安德森癌症中心,美国休斯顿)
Implicit neural representations for end-to-end PET reconstruction
Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);Centre Hospitalier Universitaire de Nantes(南特大学医院中心);INSERM(法国国家健康与医学研究院);Université d'Angers(昂热大学);CRCI2NA
Indian Institute of Technology (IIT) Bombay(印度理工学院孟买分校);IITB-Monash Research Academy(印度理工学院孟买分校-莫纳什研究学院);Monash University(莫纳什大学)
Radiation exposure in positron emission tomography (PET) imaging limits its usage in the studies of radiation-sensitive populations, e.g., pregnant women, children, and adults that require longitudinal imaging. Reducing the PET radiotracer dose or acquisition time reduces photon counts, which can deteriorate image quality. Recent deep-neural-network (DNN) based methods for image-to-image translation enable the mapping of low-quality PET images (acquired using substantially reduced dose), coupled with the associated magnetic resonance imaging (MRI) images, to high-quality PET images. However, s…
The integration of Time-of-Flight (TOF) information in the reconstruction process of Positron Emission Tomography (PET) yields improved image properties. However, implementing the cutting-edge model-based deep learning methods for TOF-PET reconstruction is challenging due to the substantial memory requirements. In this study, we present a novel model-based deep learning approach, LMPDNet, for TOF-PET reconstruction from list-mode data. We address the issue of real-time parallel computation of the projection matrix for list-mode data, and propose an iterative model-based module that utilizes a …
Zhejiang University(浙江大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Florida(佛罗里达大学);Massachusetts General Brigham(麻省总医院布莱根医疗系统)
Deep learning based PET image reconstruction methods have achieved promising results recently. However, most of these methods follow a supervised learning paradigm, which rely heavily on the availability of high-quality training labels. In particular, the long scanning time required and high radiation exposure associated with PET scans make obtaining this labels impractical. In this paper, we propose a dual-domain unsupervised PET image reconstruction method based on learned decent algorithm, which reconstructs high-quality PET images from sinograms without the need for image labels. Specifica…
Gordon Center for Medical Imaging(戈登医学影像中心);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Martinos Center for Biomedical Imaging(马蒂诺斯生物医学影像中心);University of California, Davis(加州大学戴维斯分校)
Direct reconstruction methods have been developed to estimate parametric images directly from the measured PET sinograms by combining the PET imaging model and tracer kinetics in an integrated framework. Due to limited counts received, signal-to-noise-ratio (SNR) and resolution of parametric images produced by direct reconstruction frameworks are still limited. Recently supervised deep learning methods have been successfully applied to medical imaging denoising/reconstruction when large number of high-quality training labels are available. For static PET imaging, high-quality training labels c…
A unified self-supervised and supervised deep learning framework for PET image reconstruction is presented, including deep-learned filtered backprojection (DL-FBP) for sinograms, deep-learned backproject then filter (DL-BPF) for backprojected images, and a more general mapping using a deep network in both the sinogram and image domains (DL-FBP-F). The framework allows varying amounts and types of training data, from the case of having only one single dataset to reconstruct through to the case of having numerous measured datasets, which may or may not be paired with high-quality references. For…
Sichuan University(四川大学);MinFound Medical Systems Co., Ltd(明峰医疗系统股份有限公司)
Positron emission tomography (PET) reconstruction has become an ill-posed inverse problem due to low-count projection data, and a robust algorithm is urgently required to improve imaging quality. Recently, the deep image prior (DIP) has drawn much attention and has been successfully applied in several image restoration tasks, such as denoising and inpainting, since it does not need any labels (reference image). However, overfitting is a vital defect of this framework. Hence, many methods have been proposed to mitigate this problem, and DeepRED is a typical representation that combines DIP and …
Zhejiang University(浙江大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);First Hospital of Shanxi Medical University(山西医科大学第一医院)
Patlak model is widely used in 18F-FDG dynamic positron emission tomography (PET) imaging, where the estimated parametric images reveal important biochemical and physiology information. Because of better noise modeling and more information extracted from raw sinogram, direct Patlak reconstruction gains its popularity over the indirect approach which utilizes reconstructed dynamic PET images alone. As the prerequisite of direct Patlak methods, raw data from dynamic PET are rarely stored in clinics and difficult to obtain. In addition, the direct reconstruction is time-consuming due to the bottl…