本文提出双重提示学习方法,通过显式计数水平提示和隐式通用去噪提示引导 PET 去噪,实现单一模型对不同计数水平的可泛化去噪,并在 1940 个低计数 PET 体积上验证其优于计数条件模型。
摘要:
待去噪的正电子发射断层扫描(PET)体积本身具有不同的计数水平,这对统一模型处理各种情况提出了挑战。在这项工作中,我们借助近期兴起的提示学习来实现不同计数水平下可泛化的 PET 去噪。具体而言,我们提出双重提示,以分而治之的方式引导 PET 去噪,即一个显式的计数水平提示用于提供特定的先验信息,一个隐式的通用去噪提示用于编码基本的 PET 去噪知识。然后,我们开发了一个新颖的提示融合模块来统一异构提示,随后是一个提示-特征交互模块,将提示注入特征中。这些提示能够动态引导以噪声为条件的去噪过程。因此,我们能够高效地训练一个适用于各种计数水平的统一去噪模型,并将其部署到具有个性化提示的不同情况中。我们在 1940 个低计数 PET 3D 体积上进行了评估,这些体积来自 97 项 $^{18}$F-MK6240 tau PET 研究,均匀随机选取了 13-22\% 的事件分数。结果表明,我们的双重提示能够在已知计数水平的情况下大幅提升性能,并优于计数条件模型。
英文摘要:
The to-be-denoised positron emission tomography (PET) volumes are inherent with diverse count levels, which imposes challenges for a unified model to tackle varied cases. In this work, we resort to the recently flourished prompt learning to achieve generalizable PET denoising with different count levels. Specifically, we propose dual prompts to guide the PET denoising in a divide-and-conquer manner, i.e., an explicitly count-level prompt to provide the specific prior information and an implicitly general denoising prompt to encode the essential PET denoising knowledge. Then, a novel prompt fusion module is developed to unify the heterogeneous prompts, followed by a prompt-feature interaction module to inject prompts into the features. The prompts are able to dynamically guide the noise-conditioned denoising process. Therefore, we are able to efficiently train a unified denoising model for various count levels, and deploy it to different cases with personalized prompts. We evaluated on 1940 low-count PET 3D volumes with uniformly randomly selected 13-22\% fractions of events from 97 $^{18}$F-MK6240 tau PET studies. It shows our dual prompting can largely improve the performance with informed count-level and outperform the count-conditional model.
Gordon Center for Medical Imaging, Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院戈登医学成像中心);Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital, Harvard Medical School(哈佛医学院麻省总医院高级医学计算与分析中心);University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心)
Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a normal distribution into a specific data distribution based on iterative refinements. In this work, we proposed and evaluated different DDPM-based methods for PET image denoising. Under the DDPM framework, one way to perform PET image denoising is to provide the PET image and/or the prior image as the network input. Another way is to supply the prior image as th…
This paper evaluates the performance of supervised and unsupervised deep learning models for denoising positron emission tomography (PET) images in the presence of reduced acquisition times. Our experiments consider 212 studies (56908 images), and evaluate the models using 2D (RMSE, SSIM) and 3D (SUVpeak and SUVmax error for the regions of interest) metrics. It was shown that, in contrast to previous studies, supervised models (ResNet, Unet, SwinIR) outperform unsupervised models (pix2pix GAN and CycleGAN with ResNet backbone and various auxiliary losses) in the reconstruction of 2D PET images…
Cycle-Constrained Adversarial Denoising Convolutional Network for PET Image Denoising: Multi-Dimensional Validation on Large Datasets with Reader Study and Real Low-Dose Data
Volumetric Conditional Score-based Residual Diffusion Model for PET/MR Denoising
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Zhejiang University(浙江大学);Tsinghua University(清华大学);Neuroscience Research Institute(神经科学研究所);Gachon University of Medicine and Science(嘉泉医科大学)
MDAA-Diff: CT-Guided Multi-Dose Adaptive Attention Diffusion Model for PET Denoising
School of Biomedical Engineering, Southern Medical University(南方医科大学生物医学工程学院);School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);Nanfang PET Center, Nanfang Hospital Southern Medical University(南方医科大学南芳医院PET中心)
Center of Advanced Medical Computing and Analysis, MGH/HMS(麻省总医院/哈佛医学院高级医学计算与分析中心);Johns Hopkins University(约翰斯·霍普金斯大学);GE Healthcare(通用电气医疗);University of Bern(伯尔尼大学)
In PET, the amount of relative (signal-dependent) noise present in different body regions can be significantly different and is inherently related to the number of counts present in that region. The number of counts in a region depends, in principle and among other factors, on the total administered activity, scanner sensitivity, image acquisition duration, radiopharmaceutical tracer uptake in the region, and patient local body morphometry surrounding the region. In theory, less amount of denoising operations is needed to denoise a high-count (low relative noise) image than images a low-count …
End-to-end Triple-domain PET Enhancement: A Hybrid Denoising-and-reconstruction Framework for Reconstructing Standard-dose PET Images from Low-dose PET Sinograms
ShanghaiTech University(上海科技大学);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
提出端到端三域 TriPLET 框架,融合投影域去噪、小波域重建和图像域对抗评估,从低剂量 PET 正弦图恢复标准剂量图像,并取得最优相似度与信噪比。
Gating is commonly used in PET imaging to reduce respiratory motion blurring and facilitate more sophisticated motion correction methods. In the applications of low dose PET, however, reducing injection dose causes increased noise and reduces signal-to-noise ratio (SNR), subsequently corrupting the motion estimation/correction steps, causing inferior image quality. To tackle these issues, we first propose a Siamese adversarial network (SAN) that can efficiently recover high dose gated image volume from low dose gated image volume. To ensure the appearance consistency between the recovered gate…
FedFTN: Personalized Federated Learning with Deep Feature Transformation Network for Multi-institutional Low-count PET Denoising
Yale University(耶鲁大学);University of Southern California(南加州大学);University of California Irvine(加州大学欧文分校);University of Science and Technology of China(中国科学技术大学);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院);Inselspital, Bern University Hospital(伯尔尼大学医院 Inselspital);University of Bern(伯尔尼大学);Technical University of Munich(慕尼黑工业大学)
Self is the Best Learner: CT-free Ultra-Low-Dose PET Organ Segmentation via Collaborating Denoising and Segmentation Learning
School of Biomedical Engineering, Southern Medical University(生物医学工程学院,南方医科大学);School of Biomedical Engineering, Shanghai Jiao Tong University(生物医学工程学院,上海交通大学);Nanfang PET Center, Nanfang Hospital Southern Medical University(南芳PET中心,南方医科大学南芳医院);Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University(广东省医学图像处理重点实验室,南方医科大学);Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University(广东省医学影像与诊断技术工程实验室,南方医科大学);Pazhou Lab(琶洲实验室)
Positron Emission Tomography (PET) is an essential technique in many clinical applications that allows for quantitative imaging at the molecular level. This study aims to develop a denoising method using novel dilated convolutional neural network to recover full-count images from low-count images. We adopted similar hierarchal structure from the conventional uNet and incorporated dilated kernels in each convolution to allow the network to observe larger, and perhaps, more robust, features within the image. Our dNet were trained alongside a uNet for comparison. Our 2.5D model used a training se…
Northeastern University(东北大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Rensselaer Polytechnic Institute(伦斯勒理工学院)
Due to the widespread use of positron emission tomography (PET) in clinical practice, the potential risk of PET-associated radiation dose to patients needs to be minimized. However, with the reduction in the radiation dose, the resultant images may suffer from noise and artifacts that compromise diagnostic performance. In this paper, we propose a parameter-transferred Wasserstein generative adversarial network (PT-WGAN) for low-dose PET image denoising. The contributions of this paper are twofold: i) a PT-WGAN framework is designed to denoise low-dose PET images without compromising structural…
Quantitative accuracy and thus diagnostic precision in Emission Tomography is impaired by the inherent random characteristics of the data acquisition leading to statistical image noise. Edge preserving spatial variation regularized iterative image reconstruction approaches require case-specific control parameter adaptation for optimized contrast-vs-noise tradeoff. For MLEM reconstruction, we propose and evaluate iRDF which automatically adapts RDP edge preservation parameters according to local image noise and PET data characteristics. In order to distinguish between clustered noise spots and …
Spach Transformer: Spatial and Channel-wise Transformer Based on Local and Global Self-attentions for PET Image Denoising
Gordon Center for Medical Imaging(戈登医学影像中心);Center for Advanced Medical Computing and Analysis(高级医学计算与分析中心);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Florida(佛罗里达大学);University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心);Johns Hopkins University(约翰斯·霍普金斯大学)
针对 PET 图像噪声及三维全局自注意力计算成本高的问题,提出融合局部与全局 MSA 的空间通道编解码 Transformer,并在多示踪剂数据集上验证其去噪性能优于现有深度学习架构。
Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising
Yale University(耶鲁大学);Northwestern University(西北大学);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院);Inselspital, Bern University Hospital, University of Bern(伯尔尼大学医院 Inselspital,伯尔尼大学);Technical University of Munich(慕尼黑工业大学);Yale School of Medicine(耶鲁医学院)
Sichuan University(四川大学);MinFound Medical Systems Co., Ltd(明峰医疗系统股份有限公司)
Positron emission tomography (PET) reconstruction has become an ill-posed inverse problem due to low-count projection data, and a robust algorithm is urgently required to improve imaging quality. Recently, the deep image prior (DIP) has drawn much attention and has been successfully applied in several image restoration tasks, such as denoising and inpainting, since it does not need any labels (reference image). However, overfitting is a vital defect of this framework. Hence, many methods have been proposed to mitigate this problem, and DeepRED is a typical representation that combines DIP and …