Lesion Segmentation in PET/CT scans is an essential part of modern oncological workflows. To address the challenges of time-intensive manual annotation and high inter-observer variability, the autoPET challenge series seeks to advance automated segmentation methods in complex multi-tracer and multi-center settings. Building on this foundation, autoPET IV introduces a human-in-the-loop scenario to efficiently utilize interactive human guidance in segmentation tasks. In this work, we incorporated tracer classification, organ supervision and simulated clicks guidance into the nnUNet Residual Encoder framework, forming an integrated pipeline that demonstrates robust performance in a fully automated (zero-guidance) context and efficiently leverages iterative interactions to progressively enhance segmentation accuracy.
Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesions with different shapes, sizes, and uptake intensity may be distributed in different anatomical contexts throughout the body, and there is also significant uptake in healthy organs. Therefore, building a systemic PET/CT tumor lesion segmentation model is a challenging task. In this paper, we propose a novel step-by-step 3D segmentation method to address this problem. We achieved Dice score of 0.92, false positive volume of 0.89 and false negative volume …
Automatic segmentation of tumor lesions is a critical initial processing step for quantitative PET/CT analysis. However, numerous tumor lesion with different shapes, sizes, and uptake intensity may be distributed in different anatomical contexts throughout the body, and there is also significant uptake in healthy organs. Therefore, building a systemic PET/CT tumor lesion segmentation model is a challenging task. In this paper, we propose a novel training strategy to build deep learning models capable of systemic tumor segmentation. Our method is validated on the training set of the AutoPET 202…
Recent progress in automated PET/CT lesion segmentation using deep learning methods has demonstrated the feasibility of this task. However, tumor lesion detection and segmentation in whole-body PET/CT is still a chal-lenging task. To promote research on machine learning-based automated tumor lesion segmentation on whole-body FDG-PET/CT data, Automated Lesion Segmentation in Whole-Body FDG-PET/CT (autoPET) challenge is held, and a large, publicly available training dataset is provided. In this report, we present our solution to the autoPET challenge. We employ multi-modal residual U-Net with de…
Autopet III challenge: Incorporating anatomical knowledge into nnUNet for lesion segmentation in PET/CT
Institute for AI in Medicine (IKIM)（医学人工智能研究所）；University Hospital Essen (AöR)（埃森大学医院）；Department of Nuclear Medicine（核医学科）；Cancer Research Center Cologne Essen (CCCE)（科隆埃森癌症研究中心）；West German Cancer Center Essen University Hospital Essen (AöR)（埃森大学医院西德癌症中心）；TU Dortmund（多特蒙德工业大学）；German Cancer Consortium (DKTK, Partner site Essen)（德国癌症联盟（埃森合作站点））
本研究针对 PET/CT 病变分割，提出基于示踪剂分类和集成 nnUNet 的方法，融合解剖标签，在 autoPET III 挑战中取得高 Dice 分数。
INSA Rouen Normandie, Univ Rouen Normandie, Université Le Havre Normandie, Normandie Univ, LITIS UR 4108, F-76000 Rouen, France（法国诺曼底 Rouen 大学）；Nuclear Medicine Department, Henri Becquerel Cancer Center, Rouen, France（亨利·贝克勒尔癌症中心核医学部）；Radiotherapy Department, Henri Becquerel Cancer Center, Rouen, France（亨利·贝克勒尔癌症中心放射治疗部）；Siemens Healthineers（西门子医疗）
University Hospital Essen（埃森大学医院）；Cancer Research Center Cologne Essen（科隆埃森癌症研究中心）；University Medicine Essen（埃森大学医学院）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹健康信息与数据科学学院）；University of Minho（米尼奥大学）；Computer Algorithms for Medicine Laboratory（医学计算机算法实验室）
Tumor volume and changes in tumor characteristics over time are important biomarkers for cancer therapy. In this context, FDG-PET/CT scans are routinely used for staging and re-staging of cancer, as the radiolabeled fluorodeoxyglucose is taken up in regions of high metabolism. Unfortunately, these regions with high metabolism are not specific to tumors and can also represent physiological uptake by normal functioning organs, inflammation, or infection, making detailed and reliable tumor segmentation in these scans a demanding task. This gap in research is addressed by the AutoPET challenge, wh…
Data Diet: Can Trimming PET/CT Datasets Enhance Lesion Segmentation?
Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；HIDSS4Health - Helmholtz Information and Data Science School for Health（HIDSS4Health——亥姆霍兹健康信息与数据科学学院）；Institute for AI in Medicine（医学人工智能研究所）；University Hospital Essen（埃森大学医院）；Cancer Research Center Cologne Essen (CCCE)（科隆埃森癌症研究中心）；University Medicine Essen（埃森大学医学中心）
University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）
Multi-modality Fluorodeoxyglucose (FDG) positron emission tomography / computed tomography (PET/CT) has been routinely used in the assessment of common cancers, such as lung cancer, lymphoma, and melanoma. This is mainly attributed to the fact that PET/CT combines the high sensitivity for tumor detection of PET and anatomical information from CT. In PET/CT image assessment, automatic tumor segmentation is an important step, and in recent years, deep learning based methods have become the state-of-the-art. Unfortunately, existing methods tend to over-segment the tumor regions and include region…
Stress-testing cross-cancer generalizability of 3D nnU-Net for PET-CT tumor segmentation: multi-cohort evaluation with novel oesophageal and lung cancer datasets
QIMR Berghofer Medical Research Institute（昆士兰医学研究 institute）；Australian Institute for Bioengineering and Nanotechnology（澳大利亚生物工程与纳米技术研究所）；The University of Queensland（昆士兰大学）；Frazer Institute（弗拉泽研究所）；Princess Alexandra Hospital（亚历山大公主医院）；Faculty of Health, Medicine and Behavioural Sciences（健康、医学与行为科学学院）；School of Biomedical Sciences（生物医学科学学院）；Uppsala University（乌普萨拉大学）；Rohtak Nuclear Medcare Imaging Therapy and Research Center（罗塔克核医学成像治疗与研究中心）
Shanghai AI Lab（上海人工智能实验室）；Shanghai Jiao Tong University（上海交通大学）；University of Surrey（萨里大学）；University of Electronic Science and Technology of China（电子科技大学）；Tongji University（同济大学）
Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active tumors. However, since FDG-PET scans only provide metabolic information, healthy tissue or benign disease with irregular glucose consumption may be mistaken for cancer. To handle this challenge, PET is commonly combined with Computed Tomography~(CT), with the CT used to obtain the anatomic structure of the patient. The combination of PET-based metabolic and…
Sliding Window FastEdit: A Framework for Lesion Annotation in Whole-body PET Images
HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹信息与健康数据科学学院）；Institute for AI in Medicine (IKIM), University Hospital Essen（埃森大学医院医学人工智能研究所）
KTH Royal Institute of Technology（瑞典皇家理工学院）；Karolinska Institutet（卡罗林斯卡学院）
Tumor segmentation in PET-CT images is challenging due to the dual nature of the acquired information: low metabolic information in CT and low spatial resolution in PET. U-Net architecture is the most common and widely recognized approach when developing a fully automatic image segmentation method in the medical field. We proposed a two-step approach, aiming to refine and improve the segmentation performances of tumoral lesions in PET-CT. The first step generates a prior tumor appearance map from the PET-CT volumes, regarded as prior tumor information. The second step, consisting of a standard…
There has been growing research interest in using deep learning based method to achieve fully automated segmentation of lesion in Positron emission tomography computed tomography(PET CT) scans for the prognosis of various cancers. Recent advances in the medical image segmentation shows the nnUNET is feasible for diverse tasks. However, lesion segmentation in the PET images is not straightforward, because lesion and physiological uptake has similar distribution patterns. The Distinction of them requires extra structural information in the CT images. The present paper introduces a nnUNet based m…
Background: A crucial initial processing step for quantitative PET/CT analysis is the segmentation of tumor lesions enabling accurate feature ex-traction, tumor characterization, oncologic staging, and image-based therapy response assessment. Manual lesion segmentation is however associated with enormous effort and cost and is thus infeasible in clinical routine. Goal: The goal of this study was to report the performance of a deep neural network designed to automatically segment regions suspected of cancer in whole-body 18F-FDG PET/CT images in the context of the AutoPET challenge. Method: A c…
H2ASeg: Hierarchical Adaptive Interaction and Weighting Network for Tumor Segmentation in PET/CT Images
School of Science, Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳）理学院）；School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳）计算机科学与技术学院）
Institute for Anthropomatics and Robotics (IAR), Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院人机交互与机器人研究所）；German Cancer Consortium (DKTK)（德国癌症联盟）；HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹健康信息与数据科学学院（HIDSS4Health））；Institute for AI in Medicine (IKIM), University Hospital Essen（埃森大学医院医学人工智能研究所（IKIM））；University Hospital Essen（埃森大学医院）；West German Cancer Center, Cancer Research Center Cologne Essen (CCCE), University Medicine Essen（埃森大学医学院西德癌症中心、科隆埃森癌症研究中心（CCCE））
Positron Emission Tomography (PET) and Computer Tomography (CT) are routinely used together to detect tumors. PET/CT segmentation models can automate tumor delineation, however, current multimodal models do not fully exploit the complementary information in each modality, as they either concatenate PET and CT data or fuse them at the decision level. To combat this, we propose Mirror U-Net, which replaces traditional fusion methods with multimodal fission by factorizing the multimodal representation into modality-specific branches and an auxiliary multimodal decoder. At these branches, Mirror U…
College of Medicine and Biological Information Engineering, Northeastern University（东北大学生物医学与信息工程学院）；Department of Electrical and Computer Engineering, Steven Institute of Technology（史蒂文斯理工学院电气与计算机工程系）；Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education（医学影像智能计算教育部重点实验室）
Whole-body PET/CT scan is an important tool for diagnosing various malignancies (e.g., malignant melanoma, lymphoma, or lung cancer), and accurate segmentation of tumors is a key part for subsequent treatment. In recent years, CNN-based segmentation methods have been extensively investigated. However, these methods often give inaccurate segmentation results, such as over-segmentation and under-segmentation. Therefore, to address such issues, we propose a post-processing method based on a graph convolutional neural network (GCN) to refine inaccurate segmentation parts and improve the overall se…
Self is the Best Learner: CT-free Ultra-Low-Dose PET Organ Segmentation via Collaborating Denoising and Segmentation Learning
School of Biomedical Engineering, Southern Medical University（生物医学工程学院，南方医科大学）；School of Biomedical Engineering, Shanghai Jiao Tong University（生物医学工程学院，上海交通大学）；Nanfang PET Center, Nanfang Hospital Southern Medical University（南芳PET中心，南方医科大学南芳医院）；Guangdong Provincial Key Laboratory of Medical Image Processing, Southern Medical University（广东省医学图像处理重点实验室，南方医科大学）；Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University（广东省医学影像与诊断技术工程实验室，南方医科大学）；Pazhou Lab（琶洲实验室）
Multi-modal Evidential Fusion Network for Trustworthy PET/CT Tumor Segmentation
Soochow University（苏州大学）；the University of Hong Kong（香港大学）；Southern University of Science and Technology（南方科技大学）；Changshu Institute of Technology（常熟理工学院）；the First Affiliated Hospital of Soochow University（苏州大学附属第一医院）
University of Sydney（悉尼大学）；Royal Prince Alfred Hospital（皇家阿尔弗雷德王子医院）
Sequential whole-body 18F-Fluorodeoxyglucose (FDG) positron emission tomography (PET) scans are regarded as the imaging modality of choice for the assessment of treatment response in the lymphomas because they detect treatment response when there may not be changes on anatomical imaging. Any computerized analysis of lymphomas in whole-body PET requires automatic segmentation of the studies so that sites of disease can be quantitatively monitored over time. State-of-the-art PET image segmentation methods are based on convolutional neural networks (CNNs) given their ability to leverage annotated…
Anatomy-constrained modelling of image-derived input functions in dynamic PET using multi-organ segmentation
Department of diagnostic and interventional Radiology and Neuroradiology, University Hospital Augsburg（诊断与介入放射学及神经放射学系，奥格斯堡大学医院）；Computer-Aided Medical Procedures and Augmented Reality, Technical University of Munich（计算机辅助医疗程序与增强现实，慕尼黑技术大学）；Digital Medicine, University Hospital Augsburg（数字医学，奥格斯堡大学医院）；Center of Advanced Analytics and Predictive Sciences, University of Augsburg（高级分析与预测科学中心，奥格斯堡大学）
MS-IQA: A Multi-Scale Feature Fusion Network for PET/CT Image Quality Assessment
Harbin Institute of Technology（哈尔滨工业大学）；Nanjing University of Information Science and Technology（南京信息工程大学）；Harbin Medical University（哈尔滨医科大学）；Nanyang Technological University（南洋理工大学）；Sichuan University of Science and Engineering（四川理工学院）
ARC Training Centre for Innovative BioEngineering（ARC创新生物工程培训中心）
Distant metastases (DM) refer to the dissemination of tumors, usually, beyond the organ where the tumor originated. They are the leading cause of death in patients with soft-tissue sarcomas (STSs). Positron emission tomography-computed tomography (PET-CT) is regarded as the imaging modality of choice for the management of STSs. It is difficult to determine from imaging studies which STS patients will develop metastases. 'Radiomics' refers to the extraction and analysis of quantitative features from medical images and it has been employed to help identify such tumors. The state-of-the-art in ra…
DpDNet: An Dual-Prompt-Driven Network for Universal PET-CT Segmentation
Department of Radiology, The Netherlands Cancer Institute（荷兰癌症研究所放射科）；Department of Radiology and Nuclear Medicine, Radboud University Medical Centre（拉德堡德大学医学中心放射科与核医学科）；Faculty of Applied Sciences, Macao Polytechnic University（澳门理工学院应用科学学院）；GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre（马斯特里赫特大学医学中心癌症与发育生物学学院）
HES-SO Valais-Wallis University of Applied Sciences and Arts Western Switzerland（瑞士西部应用科学与艺术大学瓦莱州分校）；Centre Hospitalier Universitaire Vaudois (CHUV)（沃州大学中心医院）；Centre Hospitalier Universitaire de Poitiers (CHUP)（普瓦捷大学中心医院）；Univ Brest（布雷斯特大学）；INSERM（法国国家健康与医学研究院）；LaTIM（医学信息处理实验室）；Cleveland Clinic Foundation（克利夫兰医学中心基金会）；University of Sherbrooke（舍布鲁克大学）
This paper presents an overview of the second edition of the HEad and neCK TumOR (HECKTOR) challenge, organized as a satellite event of the 24th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) 2021. The challenge is composed of three tasks related to the automatic analysis of PET/CT images for patients with Head and Neck cancer (H&N), focusing on the oropharynx region. Task 1 is the automatic segmentation of H&N primary Gross Tumor Volume (GTVt) in FDG-PET/CT images. Task 2 is the automatic prediction of Progression Free Survival (PFS) from the s…
Feynman Kac Reweighted Schrödinger Bridge Matching for Surface-Based Tau PET Harmonization
Stevens Neuroimaging and Informatics Institute, University of Southern California（斯蒂文斯神经影像与信息学研究所，南加州大学）；Ming Hsieh Department of Electrical and Computer Engineering of Viterbi School of Engineering, University of Southern California（明希德电气与计算机工程系，维特比工程学院，南加州大学）；Alfred E. Mann Department of Biomedical Engineering of Viterbi School of Engineering, University of Southern California（阿尔弗雷德·E·曼生物医学工程系，维特比工程学院，南加州大学）
提出Feynman Kac重加权薛定谔桥匹配（FKRSBM）模型，通过熵正则化最优传输实现源域与目标域间的随机传输，结合子群感知端点提议和球面卷积骨干网络，在Tau PET SUVR图上实现优于现有方法的分布对齐和下游疾病分类。
Ecole Centrale de Nantes（南特中央理工学院）；Keosys Medical Imaging（Keosys医学影像公司）；University of Nantes（南特大学）；University of Angers（昂热大学）；ICO Cancer Center（ICO癌症中心）
Longitudinal image registration is challenging and has not yet benefited from major performance improvements thanks to deep-learning. Inspired by Deep Image Prior, this paper introduces a different use of deep architectures as regularizers to tackle the image registration question. We propose a subject-specific deformable registration method called MIRRBA, relying on a deep pyramidal architecture to be the prior parametric model constraining the deformation field. Diverging from the supervised learning paradigm, MIRRBA does not require a learning database, but only the pair of images to be reg…
