Spach Transformer:基于局部与全局自注意力的空间与通道 Transformer,用于 PET 图像去噪
Spach Transformer: Spatial and Channel-wise Transformer Based on Local and Global Self-attentions for PET Image Denoising
Gordon Center for Medical Imaging(戈登医学影像中心);Center for Advanced Medical Computing and Analysis(高级医学计算与分析中心);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Florida(佛罗里达大学);University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心);Johns Hopkins University(约翰斯·霍普金斯大学)
Se-In Jang, Tinsu Pan, Ye Li, Pedram Heidari, Junyu Chen, Quanzheng Li, Kuang Gong
Position emission tomography (PET) is widely used in clinics and research due to its quantitative merits and high sensitivity, but suffers from low signal-to-noise ratio (SNR). Recently convolutional neural networks (CNNs) have been widely used to improve PET image quality. Though successful and efficient in local feature extraction, CNN cannot capture long-range dependencies well due to its limited receptive field. Global multi-head self-attention (MSA) is a popular approach to capture long-range information. However, the calculation of global MSA for 3D images has high computational costs. In this work, we proposed an efficient spatial and channel-wise encoder-decoder transformer, Spach Transformer, that can leverage spatial and channel information based on local and global MSAs. Experiments based on datasets of different PET tracers, i.e., $^{18}$F-FDG, $^{18}$F-ACBC, $^{18}$F-DCFPyL, and $^{68}$Ga-DOTATATE, were conducted to evaluate the proposed framework. Quantitative results show that the proposed Spach Transformer framework outperforms state-of-the-art deep learning architectures. Our codes are available at https://github.com/sijang/SpachTransformer
This paper evaluates the performance of supervised and unsupervised deep learning models for denoising positron emission tomography (PET) images in the presence of reduced acquisition times. Our experiments consider 212 studies (56908 images), and evaluate the models using 2D (RMSE, SSIM) and 3D (SUVpeak and SUVmax error for the regions of interest) metrics. It was shown that, in contrast to previous studies, supervised models (ResNet, Unet, SwinIR) outperform unsupervised models (pix2pix GAN and CycleGAN with ResNet backbone and various auxiliary losses) in the reconstruction of 2D PET images…
Gordon Center for Medical Imaging, Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院戈登医学成像中心);Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院高级医学计算与分析中心);University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心)
Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a normal distribution into a specific data distribution based on iterative refinements. In this work, we proposed and evaluated different DDPM-based methods for PET image denoising. Under the DDPM framework, one way to perform PET image denoising is to provide the PET image and/or the prior image as the network input. Another way is to supply the prior image as th…
Low-resolution and signal-dependent noise distribution in positron emission tomography (PET) images makes denoising process an inevitable step prior to qualitative and quantitative image analysis tasks. Conventional PET denoising methods either over-smooth small-sized structures due to resolution limitation or make incorrect assumptions about the noise characteristics. Therefore, clinically important quantitative information may be corrupted. To address these challenges, we introduced a novel approach to remove signal-dependent noise in the PET images where the noise distribution was considere…
UniPET: a universal network for high-quality PET image denoising across varied dose reduction factors
School of Biological Science and Medical Engineering(生物科学与医学工程学院);State Key Laboratory of Software Development Environment(软件开发环境国家重点实验室);Key Laboratory of Biomechanics, Mechanobiology of Ministry of Education(教育部生物力学与机械生物学重点实验室);Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University(北京生物医学工程先进创新中心,北航);Department of Biomedical Engineering(生物医学工程系);Department of Gynecology Oncology(妇科肿瘤科);National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital(国家癌症中心/国家癌症临床研究中心/癌症医院);Chinese Academy of Medical Sciences(中国医学科学院);Peking Union Medical College(北京协和医学院);Xiaomi Corporation(小米公司)
Cycle-Constrained Adversarial Denoising Convolutional Network for PET Image Denoising: Multi-Dimensional Validation on Large Datasets with Reader Study and Real Low-Dose Data
Center of Advanced Medical Computing and Analysis, MGH/HMS(麻省总医院/哈佛医学院高级医学计算与分析中心);Johns Hopkins University(约翰斯·霍普金斯大学);GE Healthcare(通用电气医疗);University of Bern(伯尔尼大学)
In PET, the amount of relative (signal-dependent) noise present in different body regions can be significantly different and is inherently related to the number of counts present in that region. The number of counts in a region depends, in principle and among other factors, on the total administered activity, scanner sensitivity, image acquisition duration, radiopharmaceutical tracer uptake in the region, and patient local body morphometry surrounding the region. In theory, less amount of denoising operations is needed to denoise a high-count (low relative noise) image than images a low-count …
A Kernel Space-based Multidimensional Sparse Model for Dynamic PET Image Denoising
Zhejiang Polytechnic University of Mechanical and Electrical Engineering(浙江机电职业技术学院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥国家综合科学中心人工智能研究院);School of Electrical and Optical Engineering(南京理工大学电气与光学工程学院);Zhejiang Lab(浙江实验室);School of Intelligent Science and Technology(智能科学与技术学院);Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences(杭州高等研究院,中国科学院大学);Biomedical Imaging Laboratory (BIG), Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau(澳门大学生物医学成像实验室);College of Optical Science and Engineering(光学工程学院);College of Biomedical Engineering and Instrument Science(生物医学工程与仪器科学学院)
Hamamatsu Photonics K. K.(滨松光子学株式会社);Hamamatsu University School of Medicine(滨松医科大学)
Although supervised convolutional neural networks (CNNs) often outperform conventional alternatives for denoising positron emission tomography (PET) images, they require many low- and high-quality reference PET image pairs. Herein, we propose an unsupervised 3D PET image denoising method based on an anatomical information-guided attention mechanism. The proposed magnetic resonance-guided deep decoder (MR-GDD) utilizes the spatial details and semantic features of MR-guidance image more effectively by introducing encoder-decoder and deep decoder subnetworks. Moreover, the specific shapes and pat…
U-TTT: Towards Generalizable PET Image Denoising via Test-Time Training
School of Biological Science and Medical Engineering, Beihang University(北京航空航天大学生物科学与医学工程学院);Department of Biomedical Engineering, Tsinghua University(清华大学生物医学工程系);School of Aerospace Engineering, Tsinghua University(清华大学航天航空学院);ByteDance Inc.(字节跳动有限公司)
Exploiting network optimization stability for enhanced PET image denoising using deep image prior
Central Research Laboratory, Hamamatsu Photonics K. K.(滨松光子学株式会社中央研究所);Institute for Quantum Medical Science, National Institutes for Quantum Science and Technology (QST)(国立量子科学技术研究开发机构量子医学科学研究所);J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida(佛罗里达大学J. Crayton Pruitt家族生物医学工程系)
Sichuan University(四川大学);MinFound Medical Systems Co., Ltd(明峰医疗系统股份有限公司)
Positron emission tomography (PET) reconstruction has become an ill-posed inverse problem due to low-count projection data, and a robust algorithm is urgently required to improve imaging quality. Recently, the deep image prior (DIP) has drawn much attention and has been successfully applied in several image restoration tasks, such as denoising and inpainting, since it does not need any labels (reference image). However, overfitting is a vital defect of this framework. Hence, many methods have been proposed to mitigate this problem, and DeepRED is a typical representation that combines DIP and …
MDAA-Diff: CT-Guided Multi-Dose Adaptive Attention Diffusion Model for PET Denoising
School of Biomedical Engineering, Southern Medical University(南方医科大学生物医学工程学院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);Nanfang PET Center, Nanfang Hospital Southern Medical University(南方医科大学南芳医院PET中心)
Volumetric Conditional Score-based Residual Diffusion Model for PET/MR Denoising
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Zhejiang University(浙江大学);Tsinghua University(清华大学);Neuroscience Research Institute(神经科学研究所);Gachon University of Medicine and Science(嘉泉医科大学)
End-to-end Triple-domain PET Enhancement: A Hybrid Denoising-and-reconstruction Framework for Reconstructing Standard-dose PET Images from Low-dose PET Sinograms
ShanghaiTech University(上海科技大学);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
提出端到端三域 TriPLET 框架,融合投影域去噪、小波域重建和图像域对抗评估,从低剂量 PET 正弦图恢复标准剂量图像,并取得最优相似度与信噪比。
Gating is commonly used in PET imaging to reduce respiratory motion blurring and facilitate more sophisticated motion correction methods. In the applications of low dose PET, however, reducing injection dose causes increased noise and reduces signal-to-noise ratio (SNR), subsequently corrupting the motion estimation/correction steps, causing inferior image quality. To tackle these issues, we first propose a Siamese adversarial network (SAN) that can efficiently recover high dose gated image volume from low dose gated image volume. To ensure the appearance consistency between the recovered gate…
Structure-Adaptive Sparse Diffusion in Voxel Space for 3D Medical Image Enhancement
Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, USA(佛罗里达大学电气与计算机工程系);Department of Medicine, University of Florida, Gainesville, FL, USA(佛罗里达大学医学系);Department of Biomedical Engineering, University of Florida, Gainesville, FL, USA(佛罗里达大学生物医学工程系);Research Computing, University of Florida, Gainesville, FL, USA(佛罗里达大学研究计算中心);NVIDIA, Santa Clara, CA, USA(英伟达)
FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoising
Yale University(耶鲁大学);University of Southern California(南加州大学);University of California Irvine(加州大学欧文分校);University of Science and Technology of China(中国科学技术大学);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院);Inselspital, Bern University Hospital(伯尔尼大学医院 Inselspital);University of Bern(伯尔尼大学);Technical University of Munich(慕尼黑工业大学)
Self is the Best Learner: CT-free Ultra-Low-Dose PET Organ Segmentation via Collaborating Denoising and Segmentation Learning
School of Biomedical Engineering, Southern Medical University(生物医学工程学院,南方医科大学);School of Biomedical Engineering, Shanghai Jiao Tong University(生物医学工程学院,上海交通大学);Nanfang PET Center, Nanfang Hospital Southern Medical University(南芳PET中心,南方医科大学南芳医院);Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University(广东省医学图像处理重点实验室,南方医科大学);Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University(广东省医学影像与诊断技术工程实验室,南方医科大学);Pazhou Lab(琶洲实验室)
Northeastern University(东北大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Rensselaer Polytechnic Institute(伦斯勒理工学院)
Due to the widespread use of positron emission tomography (PET) in clinical practice, the potential risk of PET-associated radiation dose to patients needs to be minimized. However, with the reduction in the radiation dose, the resultant images may suffer from noise and artifacts that compromise diagnostic performance. In this paper, we propose a parameter-transferred Wasserstein generative adversarial network (PT-WGAN) for low-dose PET image denoising. The contributions of this paper are twofold: i) a PT-WGAN framework is designed to denoise low-dose PET images without compromising structural…
Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising
Yale University(耶鲁大学);Northwestern University(西北大学);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院);Inselspital, Bern University Hospital, University of Bern(伯尔尼大学医院 Inselspital,伯尔尼大学);Technical University of Munich(慕尼黑工业大学);Yale School of Medicine(耶鲁医学院)
Positron Emission Tomography (PET) is an essential technique in many clinical applications that allows for quantitative imaging at the molecular level. This study aims to develop a denoising method using novel dilated convolutional neural network to recover full-count images from low-count images. We adopted similar hierarchal structure from the conventional uNet and incorporated dilated kernels in each convolution to allow the network to observe larger, and perhaps, more robust, features within the image. Our dNet were trained alongside a uNet for comparison. Our 2.5D model used a training se…
Gordon Center for Medical Imaging(戈登医学影像中心);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Martinos Center for Biomedical Imaging(马蒂诺斯生物医学影像中心);University of California, Davis(加州大学戴维斯分校)
Direct reconstruction methods have been developed to estimate parametric images directly from the measured PET sinograms by combining the PET imaging model and tracer kinetics in an integrated framework. Due to limited counts received, signal-to-noise-ratio (SNR) and resolution of parametric images produced by direct reconstruction frameworks are still limited. Recently supervised deep learning methods have been successfully applied to medical imaging denoising/reconstruction when large number of high-quality training labels are available. For static PET imaging, high-quality training labels c…
Quantitative accuracy and thus diagnostic precision in Emission Tomography is impaired by the inherent random characteristics of the data acquisition leading to statistical image noise. Edge preserving spatial variation regularized iterative image reconstruction approaches require case-specific control parameter adaptation for optimized contrast-vs-noise tradeoff. For MLEM reconstruction, we propose and evaluate iRDF which automatically adapts RDP edge preservation parameters according to local image noise and PET data characteristics. In order to distinguish between clustered noise spots and …
High noise and low spatial resolution are two key confounding factors that limit the qualitative and quantitative accuracy of PET images. AI models for image denoising and deblurring are becoming increasingly popular for post-reconstruction enhancement of PET images. We present here a detailed review of recent efforts for AI-based PET image enhancement with a focus on network architectures, data types, loss functions, and evaluation metrics. We also highlight emerging areas in this field that are quickly gaining popularity, identify barriers to large-scale adoption of AI models for PET image e…
TriDo-Former: A Triple-Domain Transformer for Direct PET Reconstruction from Low-Dose Sinograms
School of Computer Science, Sichuan University(四川大学计算机学院);School of Computer Science, Chengdu University of Information Technology(成都信息工程大学计算机学院);School of Biomedical Engineering, ShanghaiTech University(上海科技大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司)
End-to-End PET Image Reconstruction via a Posterior-Mean Diffusion Model
Department of Electrical and Computer Engineering, Rice University, Houston, USA(电气与计算机工程系,里士大学,美国休斯顿);Department of Imaging Physics, University of Texas MD Anderson Cancer Center, Houston, USA(影像物理系,德克萨斯大学MD安德森癌症中心,美国休斯顿)
Implicit neural representations for end-to-end PET reconstruction
Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);Centre Hospitalier Universitaire de Nantes(南特大学医院中心);INSERM(法国国家健康与医学研究院);Université d'Angers(昂热大学);CRCI2NA
All-in-One Medical Image Restoration with Latent Diffusion-Enhanced Vector-Quantized Codebook Prior
School of Biological Science and Medical Engineering(生物科学与医学工程学院);State Key Laboratory of Software Development Environment(软件开发环境国家重点实验室);Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education(教育部生物力学与机械生物学重点实验室);Beijing Advanced Innovation Center for Biomedical Engineering(北京生物医学工程先进创新中心);Beihang University(北京航空航天大学);Department of Biomedical Engineering(生物医学工程系);Tsinghua University(清华大学);ByteDance Inc.(字节跳动公司)
Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction
Univ. Brest, LaTIM, INSERM, UMR 1101(布雷斯特大学、LaTIM研究所、法国国家健康与医学研究院、UMR 1101联合研究单位);Nuclear Medicine Department, Poitiers University Hospital(普瓦捷大学医院核医学科)
Johns Hopkins University(约翰斯·霍普金斯大学);Canon Medical Research USA, INC.(佳能医疗研究美国公司)
A convolutional neural network (ConvNet) is usually trained and then tested using images drawn from the same distribution. To generalize a ConvNet to various tasks often requires a complete training dataset that consists of images drawn from different tasks. In most scenarios, it is nearly impossible to collect every possible representative dataset as a priori. The new data may only become available after the ConvNet is deployed in clinical practice. ConvNet, however, may generate artifacts on out-of-distribution testing samples. In this study, we present Targeted Gradient Descent (TGD), a nov…
ContiLNN: Mitigating Slice Sampling Discontinuity with Liquid Neural Networks for Medical Image Restoration
Faculty of Information Engineering and Automation, Kunming University of Science and Technology(昆明理工大学信息工程与自动化学院);Academy of Artificial Intelligence and Advanced Technology, Xi’an Jiaotong-Liverpool University(西交利物浦大学人工智能与先进技术研究院);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)
A Unified Framework for Multimodal Image Reconstruction and Synthesis using Denoising Diffusion Models
Department of Computer Science and Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校计算机科学与工程系);Mallinckrodt Institute of Radiology, Washington University in St. Louis(华盛顿大学圣路易斯分校马林克罗德特放射医学研究所);Department of Electrical and Systems Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校电气与系统工程系);Department of Neurology, Washington University in St. Louis(华盛顿大学圣路易斯分校神经病学系);Department of Biomedical Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校生物医学工程系);Division of Biology and Biomedical Sciences, Washington University in St. Louis(华盛顿大学圣路易斯分校生物学与生物医学科学 division);Department of Electrical and Computer Engineering, University of Wisconsin–Madison(威斯康星大学麦迪逊分校电气与计算机工程系)
Zhejiang University(浙江大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);First Hospital of Shanxi Medical University(山西医科大学第一医院)
Patlak model is widely used in 18F-FDG dynamic positron emission tomography (PET) imaging, where the estimated parametric images reveal important biochemical and physiology information. Because of better noise modeling and more information extracted from raw sinogram, direct Patlak reconstruction gains its popularity over the indirect approach which utilizes reconstructed dynamic PET images alone. As the prerequisite of direct Patlak methods, raw data from dynamic PET are rarely stored in clinics and difficult to obtain. In addition, the direct reconstruction is time-consuming due to the bottl…
TAT: Task-Adaptive Transformer for All-in-One Medical Image Restoration
School of Biological Science and Medical Engineering(生物科学与医学工程学院);State Key Laboratory of Software Development Environment(软件开发环境国家重点实验室);Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education(教育部生物力学与机力学重点实验室);Beijing Advanced Innovation Center for Biomedical Engineering(北京生物医学工程先进创新中心);Beihang University(北京航空航天大学);Sinovision Technologies (Beijing) Co., Ltd.(北京视界科技有限公司);ByteDance Inc.(字节跳动公司)