Lung cancer is a leading cause of cancer-related deaths globally. PET-CT is crucial for imaging lung tumors, providing essential metabolic and anatomical information, while it faces challenges such as poor image quality, motion artifacts, and complex tumor morphology. Deep learning-based models are expected to address these problems, however, existing small-scale and private datasets limit significant performance improvements for these methods. Hence, we introduce a large-scale PET-CT lung tumor segmentation dataset, termed PCLT20K, which comprises 21,930 pairs of PET-CT images from 605 patients. Furthermore, we propose a cross-modal interactive perception network with Mamba (CIPA) for lung tumor segmentation in PET-CT images. Specifically, we design a channel-wise rectification module (CRM) that implements a channel state space block across multi-modal features to learn correlated representations and helps filter out modality-specific noise. A dynamic cross-modality interaction module (DCIM) is designed to effectively integrate position and context information, which employs PET images to learn regional position information and serves as a bridge to assist in modeling the relationships between local features of CT images. Extensive experiments on a comprehensive benchmark demonstrate the effectiveness of our CIPA compared to the current state-of-the-art segmentation methods. We hope our research can provide more exploration opportunities for medical image segmentation. The dataset and code are available at https://github.com/mj129/CIPA.
Multimodal positron emission tomography-computed tomography (PET-CT) is used routinely in the assessment of cancer. PET-CT combines the high sensitivity for tumor detection with PET and anatomical information from CT. Tumor segmentation is a critical element of PET-CT but at present, there is not an accurate automated segmentation method. Segmentation tends to be done manually by different imaging experts and it is labor-intensive and prone to errors and inconsistency. Previous automated segmentation methods largely focused on fusing information that is extracted separately from the PET and CT…
Multi-stage intermediate fusion for multimodal learning to classify non-small cell lung cancer subtypes from CT and PET
Humanitas University（乌尼塔斯大学）；Università Vita-Salute San Raffaele（圣拉斐尔生命健康大学）；IRCCS Ospedale San Raffaele（圣拉斐尔医院附属国家科研中心）；Università Campus Bio-Medico di Roma（罗马生物医学大学校园大学）；Umeå University（于默奥大学）
Stress-testing cross-cancer generalizability of 3D nnU-Net for PET-CT tumor segmentation: multi-cohort evaluation with novel oesophageal and lung cancer datasets
QIMR Berghofer Medical Research Institute（昆士兰医学研究 institute）；Australian Institute for Bioengineering and Nanotechnology（澳大利亚生物工程与纳米技术研究所）；The University of Queensland（昆士兰大学）；Frazer Institute（弗拉泽研究所）；Princess Alexandra Hospital（亚历山大公主医院）；Faculty of Health, Medicine and Behavioural Sciences（健康、医学与行为科学学院）；School of Biomedical Sciences（生物医学科学学院）；Uppsala University（乌普萨拉大学）；Rohtak Nuclear Medcare Imaging Therapy and Research Center（罗塔克核医学成像治疗与研究中心）
Cancer is the uncontrollable cell division of abnormal cells inside the human body, which can spread to other body organs. It is one of the non-communicable diseases (NCDs) and NCDs accounts for 71% of total deaths worldwide whereas lung cancer is the second most diagnosed cancer after female breast cancer. Cancer survival rate of lung cancer is only 19%. There are various methods for the diagnosis of lung cancer, such as X-ray, CT scan, PET-CT scan, bronchoscopy and biopsy. However, to know the subtype of lung cancer based on the tissue type H and E staining is widely used, where the staining…
Anatomy-constrained modelling of image-derived input functions in dynamic PET using multi-organ segmentation
Department of diagnostic and interventional Radiology and Neuroradiology, University Hospital Augsburg（诊断与介入放射学及神经放射学系，奥格斯堡大学医院）；Computer-Aided Medical Procedures and Augmented Reality, Technical University of Munich（计算机辅助医疗程序与增强现实，慕尼黑技术大学）；Digital Medicine, University Hospital Augsburg（数字医学，奥格斯堡大学医院）；Center of Advanced Analytics and Predictive Sciences, University of Augsburg（高级分析与预测科学中心，奥格斯堡大学）
University of Patras（帕特雷大学）；School of Medicine（医学院）；Laboratory of Nuclear Medicine（核医学实验室）
Lung Cancer is the most common cause of cancer-related death worldwide. Early and automatic diagnosis of Solitary Pulmonary Nodules (SPN) in Computer Tomography (CT) chest scans can provide early treatment as well as doctor liberation from time-consuming procedures. Deep Learning has been proven as a popular and influential method in many medical imaging diagnosis areas. In this study, we consider the problem of diagnostic classification between benign and malignant lung nodules in CT images derived from a PET/CT scanner. More specifically, we intend to develop experimental Convolutional Neura…
The objective of this study was to develop a PET tumor-segmentation framework that addresses the challenges of limited spatial resolution, high image noise, and lack of clinical training data with ground-truth tumor boundaries in PET imaging. We propose a three-module PET-segmentation framework in the context of segmenting primary tumors in 3D FDG-PET images of patients with lung cancer on a per-slice basis. The first module generates PET images containing highly realistic tumors with known ground-truth using a new stochastic and physics-based approach, addressing lack of training data. The se…
University of Iowa（爱荷华大学）；Stanford University（斯坦福大学）
Non-small-cell lung cancer (NSCLC) represents approximately 80-85% of lung cancer diagnoses and is the leading cause of cancer-related death worldwide. Recent studies indicate that image-based radiomics features from positron emission tomography-computed tomography (PET/CT) images have predictive power on NSCLC outcomes. To this end, easily calculated functional features such as the maximum and the mean of standard uptake value (SUV) and total lesion glycolysis (TLG) are most commonly used for NSCLC prognostication, but their prognostic value remains controversial. Meanwhile, convolutional neu…
Washington University in St. Louis（圣路易斯华盛顿大学）；Washington University School of Medicine（华盛顿大学医学院）；Mallinckrodt Institute of Radiology（马林克罗德放射研究所）
Tumor segmentation in oncological PET is challenging, a major reason being the partial-volume effects that arise due to low system resolution and finite voxel size. The latter results in tissue-fraction effects, i.e. voxels contain a mixture of tissue classes. Conventional segmentation methods are typically designed to assign each voxel in the image as belonging to a certain tissue class. Thus, these methods are inherently limited in modeling tissue-fraction effects. To address the challenge of accounting for partial-volume effects, and in particular, tissue-fraction effects, we propose a Baye…
COMSATS University Islamabad（COMSATS伊斯兰堡大学）；National University of Ireland, Galway（爱尔兰国立高威大学）；Umeå University（于默奥大学）
Chest X-ray (CXR) is a low-cost medical imaging technique. It is a common procedure for the identification of many respiratory diseases compared to MRI, CT, and PET scans. This paper presents the use of generative adversarial networks (GAN) to perform the task of lung segmentation on a given CXR. GANs are popular to generate realistic data by learning the mapping from one domain to another. In our work, the generator of the GAN is trained to generate a segmented mask of a given input CXR. The discriminator distinguishes between a ground truth and the generated mask, and updates the generator t…
University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）
Multi-modality Fluorodeoxyglucose (FDG) positron emission tomography / computed tomography (PET/CT) has been routinely used in the assessment of common cancers, such as lung cancer, lymphoma, and melanoma. This is mainly attributed to the fact that PET/CT combines the high sensitivity for tumor detection of PET and anatomical information from CT. In PET/CT image assessment, automatic tumor segmentation is an important step, and in recent years, deep learning based methods have become the state-of-the-art. Unfortunately, existing methods tend to over-segment the tumor regions and include region…
Purpose: Functional imaging is emerging as an important tool for lung cancer treatment planning and evaluation. Compared with traditional methods such as nuclear medicine ventilation-perfusion (VQ), positron emission tomography (PET), single photon emission computer tomography (SPECT), or magnetic resonance imaging (MRI), which use contrast agents to form 2D or 3D functional images, ventilation imaging obtained from 4DCT lung images is convenient and cost-effective because of its availability during radiation treatment planning. Current methods of obtaining ventilation images from 4DCT lung im…
General Electric Healthcare（通用电气医疗集团）；University of Rouen（鲁昂大学）；Centre Henri Becquerel（亨利·贝克勒尔中心）
Background and Objectives: Predicting patient response to treatment and survival in oncology is a prominent way towards precision medicine. To that end, radiomics was proposed as a field of study where images are used instead of invasive methods. The first step in radiomic analysis is the segmentation of the lesion. However, this task is time consuming and can be physician subjective. Automated tools based on supervised deep learning have made great progress to assist physicians. However, they are data hungry, and annotated data remains a major issue in the medical field where only a small sub…
College of Medicine and Biological Information Engineering, Northeastern University（东北大学生物医学与信息工程学院）；Department of Electrical and Computer Engineering, Steven Institute of Technology（史蒂文斯理工学院电气与计算机工程系）；Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education（医学影像智能计算教育部重点实验室）
Whole-body PET/CT scan is an important tool for diagnosing various malignancies (e.g., malignant melanoma, lymphoma, or lung cancer), and accurate segmentation of tumors is a key part for subsequent treatment. In recent years, CNN-based segmentation methods have been extensively investigated. However, these methods often give inaccurate segmentation results, such as over-segmentation and under-segmentation. Therefore, to address such issues, we propose a post-processing method based on a graph convolutional neural network (GCN) to refine inaccurate segmentation parts and improve the overall se…
University Hospital Essen（埃森大学医院）；Cancer Research Center Cologne Essen（科隆埃森癌症研究中心）；University Medicine Essen（埃森大学医学院）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；HIDSS4Health - Helmholtz Information and Data Science School for Health（亥姆霍兹健康信息与数据科学学院）；University of Minho（米尼奥大学）；Computer Algorithms for Medicine Laboratory（医学计算机算法实验室）
Tumor volume and changes in tumor characteristics over time are important biomarkers for cancer therapy. In this context, FDG-PET/CT scans are routinely used for staging and re-staging of cancer, as the radiolabeled fluorodeoxyglucose is taken up in regions of high metabolism. Unfortunately, these regions with high metabolism are not specific to tumors and can also represent physiological uptake by normal functioning organs, inflammation, or infection, making detailed and reliable tumor segmentation in these scans a demanding task. This gap in research is addressed by the AutoPET challenge, wh…
GLOW-FDG: Generalized cancer LesiOn Whole-body segmentation model for $^{18}$F-FDG-PET/CT
Department of Radiation Oncology, University Hospital Zurich, University of Zurich, Zurich, Switzerland（苏黎世大学放射肿瘤科，苏黎世大学，苏黎世，瑞士）；Faculty of Medicine, University of Zurich, Zurich, Switzerland（苏黎世大学医学院，苏黎世，瑞士）；Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany（德国癌症研究中心（DKFZ）医学图像计算部，海德堡，德国）；Department of Radiation Oncology, Institut de Cancérologie de Lorraine, Vandœuvre-lès-Nancy, France（洛林癌症研究所放射肿瘤科，法国 Vandœuvre-lès-Nancy）；Department of Thoracic Surgery, University Hospital Zurich, University of Zurich, Zurich, Switzerland（苏黎世大学胸外科科，苏黎世大学，苏黎世，瑞士）；ETOP IBCSG Partners Foundation, Bern, Switzerland（ETOP IBCSG合作伙伴基金会，瑞士伯恩）；Department of Nuclear Medicine, University Hospital Zurich, University of Zurich, Zurich, Switzerland（苏黎世大学核医学科，苏黎世大学，苏黎世，瑞士）
Three-dimensional (3D) images, such as CT, MRI, and PET, are common in medical imaging applications and important in clinical diagnosis. Semantic ambiguity is a typical feature of many medical image labels. It can be caused by many factors, such as the imaging properties, pathological anatomy, and the weak representation of the binary masks, which brings challenges to accurate 3D segmentation. In 2D medical images, using soft masks instead of binary masks generated by image matting to characterize lesions can provide rich semantic information, describe the structural characteristics of lesions…
