Tumor segmentation in PET-CT images is challenging due to the dual nature of the acquired information: low metabolic information in CT and low spatial resolution in PET. U-Net architecture is the most common and widely recognized approach when developing a fully automatic image segmentation method in the medical field. We proposed a two-step approach, aiming to refine and improve the segmentation performances of tumoral lesions in PET-CT. The first step generates a prior tumor appearance map from the PET-CT volumes, regarded as prior tumor information. The second step, consisting of a standard U-Net, receives the prior tumor appearance map and PET-CT images to generate the lesion mask. We evaluated the method on the 1014 cases available for the AutoPET 2022 challenge, and the results showed an average Dice score of 0.701 on the positive cases.
Recent progress in automated PET/CT lesion segmentation using deep learning methods has demonstrated the feasibility of this task. However, tumor lesion detection and segmentation in whole-body PET/CT is still a chal-lenging task. To promote research on machine learning-based automated tumor lesion segmentation on whole-body FDG-PET/CT data, Automated Lesion Segmentation in Whole-Body FDG-PET/CT (autoPET) challenge is held, and a large, publicly available training dataset is provided. In this report, we present our solution to the autoPET challenge. We employ multi-modal residual U-Net with de…
Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesion with different shapes, sizes, and uptake intensity may be distributed in different anatomical contexts throughout the body, and there is also significant uptake in healthy organs. Therefore, building a systemic PET/CT tumor lesion segmentation model is a challenging task. In this paper, we propose a novel training strategy to build deep learning models capable of systemic tumor segmentation. Our method is validated on the training set of the AutoPET 202…
There has been growing research interest in using deep learning based method to achieve fully automated segmentation of lesion in Positron emission tomography computed tomography(PET CT) scans for the prognosis of various cancers. Recent advances in the medical image segmentation shows the nnUNET is feasible for diverse tasks. However, lesion segmentation in the PET images is not straightforward, because lesion and physiological uptake has similar distribution patterns. The Distinction of them requires extra structural information in the CT images. The present paper introduces a nnUNet based m…
Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesions with different shapes, sizes, and uptake intensity may be distributed in different anatomical contexts throughout the body, and there is also significant uptake in healthy organs. Therefore, building a systemic PET/CT tumor lesion segmentation model is a challenging task. In this paper, we propose a novel step-by-step 3D segmentation method to address this problem. We achieved Dice score of 0.92, false positive volume of 0.89 and false negative volume …
Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans
Technical University of Munich（慕尼黑工业大学）；TUM School of Natural Sciences（慕尼黑工业大学自然科学学院）；Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Munich Institute of Biomedical Engineering（慕尼黑生物医学工程研究所）
Shanghai AI Lab（上海人工智能实验室）；Shanghai Jiao Tong University（上海交通大学）；University of Surrey（萨里大学）；University of Electronic Science and Technology of China（电子科技大学）；Tongji University（同济大学）
Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active tumors. However, since FDG-PET scans only provide metabolic information, healthy tissue or benign disease with irregular glucose consumption may be mistaken for cancer. To handle this challenge, PET is commonly combined with Computed Tomography~(CT), with the CT used to obtain the anatomic structure of the patient. The combination of PET-based metabolic and…
Sliding Window FastEdit: A Framework for Lesion Annotation in Whole-body PET Images
HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹信息与健康数据科学学院）；Institute for AI in Medicine (IKIM), University Hospital Essen（埃森大学医院医学人工智能研究所）
Autopet III challenge: Incorporating anatomical knowledge into nnUNet for lesion segmentation in PET/CT
Institute for AI in Medicine (IKIM)（医学人工智能研究所）；University Hospital Essen (AöR)（埃森大学医院）；Department of Nuclear Medicine（核医学科）；Cancer Research Center Cologne Essen (CCCE)（科隆埃森癌症研究中心）；West German Cancer Center Essen University Hospital Essen (AöR)（埃森大学医院西德癌症中心）；TU Dortmund（多特蒙德工业大学）；German Cancer Consortium (DKTK, Partner site Essen)（德国癌症联盟（埃森合作站点））
本研究针对 PET/CT 病变分割，提出基于示踪剂分类和集成 nnUNet 的方法，融合解剖标签，在 autoPET III 挑战中取得高 Dice 分数。
General Electric Healthcare（通用电气医疗集团）；University of Rouen（鲁昂大学）；Henri Becquerel Center（亨利·贝克勒尔中心）
One of the most challenges in medical imaging is the lack of data. It is proven that classical data augmentation methods are useful but still limited due to the huge variation in images. Using generative adversarial networks (GAN) is a promising way to address this problem, however, it is challenging to train one model to generate different classes of lesions. In this paper, we propose a deep convolutional conditional generative adversarial network to generate MIP positron emission tomography image (PET) which is a 2D image that represents a 3D volume for fast interpretation, according to diff…
DpDNet: An Dual-Prompt-Driven Network for Universal PET-CT Segmentation
Department of Radiology, The Netherlands Cancer Institute（荷兰癌症研究所放射科）；Department of Radiology and Nuclear Medicine, Radboud University Medical Centre（拉德堡德大学医学中心放射科与核医学科）；Faculty of Applied Sciences, Macao Polytechnic University（澳门理工学院应用科学学院）；GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre（马斯特里赫特大学医学中心癌症与发育生物学学院）
BC Cancer Research Institute（不列颠哥伦比亚癌症研究所）；University of British Columbia（不列颠哥伦比亚大学）；Simon Fraser University（西蒙弗雷泽大学）
We utilized a 3D nnU-Net model with residual layers supplemented by squeeze and excitation (SE) normalization for tumor segmentation from PET/CT images provided by the Head and Neck Tumor segmentation chal-lenge (HECKTOR). Our proposed loss function incorporates the Unified Fo-cal and Mumford-Shah losses to take the advantage of distribution, region, and boundary-based loss functions. The results of leave-one-out-center-cross-validation performed on different centers showed a segmentation performance of 0.82 average Dice score (DSC) and 3.16 median Hausdorff Distance (HD), and our results on t…
Numerous oncology indications have extensively quantified metabolically active tumors using positron emission tomography (PET) and computed tomography (CT). F-fluorodeoxyglucose-positron emission tomography (FDG-PET) is frequently utilized in clinical practice and clinical drug research to detect and measure metabolically active malignancies. The assessment of tumor burden using manual or computer-assisted tumor segmentation in FDG-PET images is widespread. Deep learning algorithms have also produced effective solutions in this area. However, there may be a need to improve the performance of a…
Data Diet: Can Trimming PET/CT Datasets Enhance Lesion Segmentation?
Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；HIDSS4Health - Helmholtz Information and Data Science School for Health（HIDSS4Health——亥姆霍兹健康信息与数据科学学院）；Institute for AI in Medicine（医学人工智能研究所）；University Hospital Essen（埃森大学医院）；Cancer Research Center Cologne Essen (CCCE)（科隆埃森癌症研究中心）；University Medicine Essen（埃森大学医学中心）
GLOW-FDG: Generalized cancer LesiOn Whole-body segmentation model for $^{18}$F-FDG-PET/CT
Department of Radiation Oncology, University Hospital Zurich, University of Zurich, Zurich, Switzerland（苏黎世大学放射肿瘤科，苏黎世大学，苏黎世，瑞士）；Faculty of Medicine, University of Zurich, Zurich, Switzerland（苏黎世大学医学院，苏黎世，瑞士）；Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany（德国癌症研究中心（DKFZ）医学图像计算部，海德堡，德国）；Department of Radiation Oncology, Institut de Cancérologie de Lorraine, Vandœuvre-lès-Nancy, France（洛林癌症研究所放射肿瘤科，法国 Vandœuvre-lès-Nancy）；Department of Thoracic Surgery, University Hospital Zurich, University of Zurich, Zurich, Switzerland（苏黎世大学胸外科科，苏黎世大学，苏黎世，瑞士）；ETOP IBCSG Partners Foundation, Bern, Switzerland（ETOP IBCSG合作伙伴基金会，瑞士伯恩）；Department of Nuclear Medicine, University Hospital Zurich, University of Zurich, Zurich, Switzerland（苏黎世大学核医学科，苏黎世大学，苏黎世，瑞士）
INSA Rouen Normandie, Univ Rouen Normandie, Université Le Havre Normandie, Normandie Univ, LITIS UR 4108, F-76000 Rouen, France（法国诺曼底 Rouen 大学）；Nuclear Medicine Department, Henri Becquerel Cancer Center, Rouen, France（亨利·贝克勒尔癌症中心核医学部）；Radiotherapy Department, Henri Becquerel Cancer Center, Rouen, France（亨利·贝克勒尔癌症中心放射治疗部）；Siemens Healthineers（西门子医疗）
Rethinking Annotator Simulation: Realistic Evaluation of Whole-Body PET Lesion Interactive Segmentation Methods
Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；HIDSS4Health - Helmholtz Information and Data Science School for Health（HIDSS4Health亥姆霍兹健康信息与数据科学学院）；Institute for AI in Medicine, University Hospital Essen（埃森大学医院医学人工智能研究所）；Cancer Research Center Cologne Essen (CCCE), University Medicine Essen（埃森大学医学院科隆埃森癌症研究中心）
College of Medicine and Biological Information Engineering, Northeastern University（东北大学生物医学与信息工程学院）；Department of Electrical and Computer Engineering, Steven Institute of Technology（史蒂文斯理工学院电气与计算机工程系）；Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education（医学影像智能计算教育部重点实验室）
Whole-body PET/CT scan is an important tool for diagnosing various malignancies (e.g., malignant melanoma, lymphoma, or lung cancer), and accurate segmentation of tumors is a key part for subsequent treatment. In recent years, CNN-based segmentation methods have been extensively investigated. However, these methods often give inaccurate segmentation results, such as over-segmentation and under-segmentation. Therefore, to address such issues, we propose a post-processing method based on a graph convolutional neural network (GCN) to refine inaccurate segmentation parts and improve the overall se…
Background: A crucial initial processing step for quantitative PET/CT analysis is the segmentation of tumor lesions enabling accurate feature ex-traction, tumor characterization, oncologic staging, and image-based therapy response assessment. Manual lesion segmentation is however associated with enormous effort and cost and is thus infeasible in clinical routine. Goal: The goal of this study was to report the performance of a deep neural network designed to automatically segment regions suspected of cancer in whole-body 18F-FDG PET/CT images in the context of the AutoPET challenge. Method: A c…
Whole-Body Image-to-Image Translation for a Virtual Scanner in a Healthcare Digital Twin
Department of Computing Science, Umeå University（计算科学系，乌梅大学）；Department of Diagnostics and Intervention, Biomedical Engineering and Radiation Physics, Umeå University（诊断与介入系，生物医学工程与放射物理，乌梅大学）
Ecole Centrale de Nantes（南特中央理工学院）；Keosys Medical Imaging（Keosys医学影像公司）；University of Nantes（南特大学）；University of Angers（昂热大学）；ICO Cancer Center（ICO癌症中心）
Longitudinal image registration is challenging and has not yet benefited from major performance improvements thanks to deep-learning. Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers to tackle the image registration question. We propose a subject-specific deformable registration method called MIRRBA, relying on a deep pyramidal architecture to be the prior parametric model constraining the deformation field. Diverging from the supervised learning paradigm, MIRRBA does not require a learning database, but only the pair of images to be reg…
General Electric Healthcare（通用电气医疗集团）；University of Rouen（鲁昂大学）；Henri Becquerel Center（亨利·贝克勒尔中心）
One of the most challenges in medical imaging is the lack of data and annotated data. It is proven that classical segmentation methods such as U-NET are useful but still limited due to the lack of annotated data. Using a weakly supervised learning is a promising way to address this problem, however, it is challenging to train one model to detect and locate efficiently different type of lesions due to the huge variation in images. In this paper, we present a novel approach to locate different type of lesions in positron emission tomography (PET) images using only a class label at the image-leve…
Imam Abdulrahman Bin Faisal University（伊玛目阿卜杜勒拉赫曼·本·费萨尔大学）
To accurately quantify in vivo radiotracer uptake using Positron Emission Tomography (PET) is a challenging task due to low signal-to-noise ratio (SNR) and poor spatial resolution of PET camera along with the finite image sampling constraint. Furthermore, inter lesion variations of the SNR and contrast along with the variations in size of the lesion make the quantitation even more difficult. One of the ways to improve the quantitation is via post reconstruction filtering with Gaussian Filter (GF). Edge preserving Bilateral Filter (BF) and Nonlinear Diffusion Filter (NDF) are the alternatives t…
Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising
Yale University（耶鲁大学）；Northwestern University（西北大学）；Ruijin Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属瑞金医院）；Inselspital, Bern University Hospital, University of Bern（伯尔尼大学医院 Inselspital，伯尔尼大学）；Technical University of Munich（慕尼黑工业大学）；Yale School of Medicine（耶鲁医学院）
Manifold-Constrained PET Reconstruction with Learned Flow-Matching Priors
ZJU-UIUC Institute, Zhejiang University（浙江大学紫金港研究院）；College of Information Science and Electronic Engineering, Zhejiang University（浙江大学信息与电子工程学院）；College of Optical Science and Engineering, Zhejiang University（浙江大学光电科学与工程学院）；Vivo Mobile Communication Co., Ltd.（维沃移动通信有限公司）；College of Biomedical Engineering and Instrument Science, Zhejiang University（浙江大学生物医学工程与仪器科学学院）
Shanghai Jiao Tong University（上海交通大学）；Shanghai Ninth People’s Hospital, Shanghai Jiao Tong University School of Medicine（上海交通大学医学院附属第九人民医院）；Fudan University Shanghai Cancer Center（复旦大学附属肿瘤医院）
University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）
Multi-modality Fluorodeoxyglucose (FDG) positron emission tomography / computed tomography (PET/CT) has been routinely used in the assessment of common cancers, such as lung cancer, lymphoma, and melanoma. This is mainly attributed to the fact that PET/CT combines the high sensitivity for tumor detection of PET and anatomical information from CT. In PET/CT image assessment, automatic tumor segmentation is an important step, and in recent years, deep learning based methods have become the state-of-the-art. Unfortunately, existing methods tend to over-segment the tumor regions and include region…
Quantitative accuracy and thus diagnostic precision in Emission Tomography is impaired by the inherent random characteristics of the data acquisition leading to statistical image noise. Edge preserving spatial variation regularized iterative image reconstruction approaches require case-specific control parameter adaptation for optimized contrast-vs-noise tradeoff. For MLEM reconstruction, we propose and evaluate iRDF which automatically adapts RDP edge preservation parameters according to local image noise and PET data characteristics. In order to distinguish between clustered noise spots and …
