FreeTumor: Large-Scale Generative Tumor Synthesis in Computed Tomography Images for Improving Tumor Recognition
The Hong Kong University of Science and Technology(香港科技大学);Tencent AI Lab(腾讯AI实验室);Harvard University(哈佛大学);The Chinese University of Hong Kong(香港中文大学);The Third Affiliated Hospital of Southern Medical University(南方医科大学第三附属医院);Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University(中山大学孙逸仙纪念医院);The University of Hong Kong(香港大学);Shenzhen-Hong Kong Collaborative Innovation Research Institute(深港产学研协同创新研究院)
Tumor is a leading cause of death worldwide, with an estimated 10 million deaths attributed to tumor-related diseases every year. AI-driven tumor recognition unlocks new possibilities for more precise and intelligent tumor screening and diagnosis. However, the progress is heavily hampered by the scarcity of annotated datasets, which demands extensive annotation efforts by radiologists. To tackle this challenge, we introduce FreeTumor, an innovative Generative AI (GAI) framework to enable large-scale tumor synthesis for mitigating data scarcity. Specifically, FreeTumor effectively leverages a combination of limited labeled data and large-scale unlabeled data for tumor synthesis training. Unleashing the power of large-scale data, FreeTumor is capable of synthesizing a large number of realistic tumors on images for augmenting training datasets. To this end, we create the largest training dataset for tumor synthesis and recognition by curating 161,310 publicly available Computed Tomography (CT) volumes from 33 sources, with only 2.3% containing annotated tumors. To validate the fidelity of synthetic tumors, we engaged 13 board-certified radiologists in a Visual Turing Test to discern between synthetic and real tumors. Rigorous clinician evaluation validates the high quality of our synthetic tumors, as they achieved only 51.1% sensitivity and 60.8% accuracy in distinguishing our synthetic tumors from real ones. Through high-quality tumor synthesis, FreeTumor scales up the recognition training datasets by over 40 times, showcasing a notable superiority over state-of-the-art AI methods including various synthesis methods and foundation models. These findings indicate promising prospects of FreeTumor in clinical applications, potentially advancing tumor treatments and improving the survival rates of patients.
Velammal College of Engg and Tech(维拉马尔工程技术学院);Thiagarajar College of Engg(蒂亚加拉贾工程技术学院)
The research work presented in this paper is to achieve the tissue classification and automatically diagnosis the abnormal tumor region present in Computed Tomography (CT) images using the wavelet based statistical texture analysis method. Comparative studies of texture analysis method are performed for the proposed wavelet based texture analysis method and Spatial Gray Level Dependence Method (SGLDM). Our proposed system consists of four phases i) Discrete Wavelet Decomposition (ii) Feature extraction (iii) Feature selection (iv) Analysis of extracted texture features by classifier. A wavelet…
Mansoura University(曼苏尔大学);South Valley University(南河谷大学);Higher Institute of Engineering and Technology(高等工程技术学院)
The liver is one of the most critical metabolic organs in vertebrates due to its vital functions in the human body, such as detoxification of the blood from waste products and medications. Liver diseases due to liver tumors are one of the most common mortality reasons around the globe. Hence, detecting liver tumors in the early stages of tumor development is highly required as a critical part of medical treatment. Many imaging modalities can be used as aiding tools to detect liver tumors. Computed tomography (CT) is the most used imaging modality for soft tissue organs such as the liver. This …
Comparative Study of UNet-based Architectures for Liver Tumor Segmentation in Multi-Phase Contrast-Enhanced Computed Tomography
School of Computer Science and Engineering(计算机科学与工程学院);The Saigon International University(暹罗国际大学);School of Biomedical Engineering(生物医学工程学院);International University(国际大学);Vietnam National University HCMC(越南国家大学胡志明市分校)
Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography
City University of Hong Kong(香港城市大学);Johns Hopkins University(约翰斯·霍普金斯大学);University of California, San Francisco(加州大学旧金山分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Chinese University of Hong Kong(香港中文大学);NVIDIA(英伟达)
LaTIM, INSERM, UMR 1101, University Brest(拉蒂姆研究所、法国国家健康与医学研究院、布雷斯特大学)
Development of robust and accurate fully automated methods for medical image segmentation is crucial in clinical practice and radiomics studies. In this work, we contributed an automated approach for Head and Neck (H&N) primary tumor segmentation in combined positron emission tomography / computed tomography (PET/CT) images in the context of the MICCAI 2020 Head and Neck Tumor segmentation challenge (HECKTOR). Our model was designed on the U-Net architecture with residual layers and supplemented with Squeeze-and-Excitation Normalization. The described method achieved competitive results in cro…
Radboud University Medical Center(拉德堡德大学医学中心);Radboud Institute for Health Sciences(拉德堡德健康科学研究所)
Early detection improves prognosis in pancreatic ductal adenocarcinoma (PDAC) but is challenging as lesions are often small and poorly defined on contrast-enhanced computed tomography scans (CE-CT). Deep learning can facilitate PDAC diagnosis, however current models still fail to identify small (<2cm) lesions. In this study, state-of-the-art deep learning models were used to develop an automatic framework for PDAC detection, focusing on small lesions. Additionally, the impact of integrating surrounding anatomy was investigated. CE-CT scans from a cohort of 119 pathology-proven PDAC patients an…
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology(华中科技大学同济医学院同济医院);Shenzhen-Hong Kong Institute of Brain Science-Shenzhen Fundamental Research Institutions(深港脑科学创新研究院——深圳基础研究机构);United Imaging Research Institute of Innovative Medical Equipment(联影创新医疗装备研究院);Shenzhen Bay Laboratory(深圳湾实验室)
Achieving accurate and automated tumor segmentation plays an important role in both clinical practice and radiomics research. Segmentation in medicine is now often performed manually by experts, which is a laborious, expensive and error-prone task. Manual annotation relies heavily on the experience and knowledge of these experts. In addition, there is much intra- and interobserver variation. Therefore, it is of great significance to develop a method that can automatically segment tumor target regions. In this paper, we propose a deep learning segmentation method based on multimodal positron em…
Accurate visualization of liver tumors and their surrounding blood vessels is essential for noninvasive diagnosis and prognosis prediction of tumors. In medical image segmentation, there is still a lack of in-depth research on the simultaneous segmentation of liver tumors and peritumoral blood vessels. To this end, we collect the first liver tumor, and vessel segmentation benchmark datasets containing 52 portal vein phase computed tomography images with liver, liver tumor, and vessel annotations. In this case, we propose a 3D U-shaped Cross-Attention Network (UCA-Net) that utilizes a tailored …
College of Biomedical Engineering, Rangsit University(兰实大学生物医学工程学院)
Automated medical image segmentation is a priority research area for computational methods. In particular, detection of cancerous tumors represents a current challenge in this area with potential for real-world impact. This paper describes a method developed in response to the 2019 Kidney Tumor Segmentation Challenge (KiTS19). Axial computed tomography (CT) scans from 210 kidney cancer patients were used to develop and evaluate this automatic segmentation method based on a logical ensemble of fully-convolutional network (FCN) architectures, followed by volumetric validation. Data was pre-proce…
James Cook University(詹姆斯·库克大学);Mahidol University(玛希隆大学);University of Bremen(不来梅大学)
Automatic segmentation of hepatic lesions in computed tomography (CT) images is a challenging task to perform due to heterogeneous, diffusive shape of tumors and complex background. To address the problem more and more researchers rely on assistance of deep convolutional neural networks (CNN) with 2D or 3D type architecture that have proven to be effective in a wide range of computer vision tasks, including medical image processing. In this technical report, we carry out research focused on more careful approach to the process of learning rather than on complex architecture of the CNN. We have…
Shanghai AI Lab(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);University of Surrey(萨里大学);University of Electronic Science and Technology of China(电子科技大学);Tongji University(同济大学)
Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active tumors. However, since FDG-PET scans only provide metabolic information, healthy tissue or benign disease with irregular glucose consumption may be mistaken for cancer. To handle this challenge, PET is commonly combined with Computed Tomography~(CT), with the CT used to obtain the anatomic structure of the patient. The combination of PET-based metabolic and…
Foundation Models vs. Radiomics for Lung Computed Tomography: A Benchmark of Feature Extractors, Classification Heads, and Segmentation Choices
Division AI4Health, Carl von Ossietzky Universität Oldenburg(奥尔登堡卡尔·冯·奥西茨基大学AI4Health部门);University Institute for Diagnostic and Interventional Radiology, Klinikum Oldenburg AöR(奥尔登堡医院大学诊断与介入放射学研究所)
ARC Training Centre for Innovative BioEngineering(ARC创新生物工程培训中心)
Distant metastases (DM) refer to the dissemination of tumors, usually, beyond the organ where the tumor originated. They are the leading cause of death in patients with soft-tissue sarcomas (STSs). Positron emission tomography-computed tomography (PET-CT) is regarded as the imaging modality of choice for the management of STSs. It is difficult to determine from imaging studies which STS patients will develop metastases. 'Radiomics' refers to the extraction and analysis of quantitative features from medical images and it has been employed to help identify such tumors. The state-of-the-art in ra…
An Exceptional Dataset For Rare Pancreatic Tumor Segmentation
School of Computer Science, Fudan University(复旦大学计算机科学技术学院);Shanghai Medical College, Fudan University Shanghai Cancer Center(复旦大学上海医学院附属肿瘤医院);School of Computer Science, University of Illinois(伊利诺伊大学计算机科学学院)
Indian Institute of Technology Roorkee(印度理工学院鲁尔基分校)
Relatively abundant availability of medical imaging data has provided significant support in the development and testing of Neural Network based image processing methods. Clinicians often face issues in selecting suitable image processing algorithm for medical imaging data. A strategy for the selection of a proper model is presented here. The training data set comprises optical coherence tomography (OCT) and angiography (OCT-A) images of 50 mice eyes with more than 100 days follow-up. The data contains images from treated and untreated mouse eyes. Four deep learning variants are tested for aut…
General Electric Healthcare(通用电气医疗集团);University of Rouen(鲁昂大学);Henri Becquerel Center(亨利·贝克勒尔中心)
One of the most challenges in medical imaging is the lack of data and annotated data. It is proven that classical segmentation methods such as U-NET are useful but still limited due to the lack of annotated data. Using a weakly supervised learning is a promising way to address this problem, however, it is challenging to train one model to detect and locate efficiently different type of lesions due to the huge variation in images. In this paper, we present a novel approach to locate different type of lesions in positron emission tomography (PET) images using only a class label at the image-leve…
Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon, Korea(延世大学电气与计算机工程系);Department of Radiology and Center for Imaging Science, Samsung Medical Center, Sungkyunkwan University School of Medicine, Suwon, Korea(延世大学医学院放射科与成像科学中心)
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Lenovo Research(联想研究院);Lenovo Ltd.(联想集团有限公司)
Liver cancer is one of the most common cancers worldwide. Due to inconspicuous texture changes of liver tumor, contrast-enhanced computed tomography (CT) imaging is effective for the diagnosis of liver cancer. In this paper, we focus on improving automated liver tumor segmentation by integrating multi-modal CT images. To this end, we propose a novel mutual learning (ML) strategy for effective and robust multi-modal liver tumor segmentation. Different from existing multi-modal methods that fuse information from different modalities by a single model, with ML, an ensemble of modality-specific mo…
Tianjin University(天津大学);CSIRO Data61(澳大利亚联邦科学与工业研究组织Data61);La Trobe University(乐卓博大学);Tianjin University of Traditional Chinese Medicine(天津中医药大学)
The insufficiency of annotated medical imaging scans for cancer makes it challenging to train and validate data-hungry deep learning models in precision oncology. We propose a new richer generative adversarial network for free-form 3D tumor/lesion synthesis in computed tomography (CT) images. The network is composed of a new richer convolutional feature enhanced dilated-gated generator (RicherDG) and a hybrid loss function. The RicherDG has dilated-gated convolution layers to enable tumor-painting and to enlarge perceptive fields; and it has a novel richer convolutional feature association bra…
Scaling Artificial Intelligence for Multi-Tumor Early Detection with More Reports, Fewer Masks
Johns Hopkins University(约翰霍普金斯大学);University of Bologna(博洛尼亚大学);Istituto Italiano di Tecnologia(意大利理工学院);Jagiellonian University(雅盖隆大学);University of California, Berkeley(加州大学伯克利分校);Warmian-Masurian Cancer Center(马里安马祖尔癌症中心);University of Zurich(苏黎世大学);ETH AI Center(苏黎世联邦理工学院人工智能中心);Istanbul Medipol University(伊斯坦布尔梅迪波尔大学);University of California, Santa Cruz(加州大学圣克鲁兹分校);Stanford University(斯坦福大学);University of Warmia and Mazury(马里安马祖尔大学);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);University of California, San Francisco(加州大学旧金山分校)
Memorial Sloan Kettering Cancer Center(纪念斯隆·凯特琳癌症中心)
Lung tumors, especially those located close to or surrounded by soft tissues like the mediastinum, are difficult to segment due to the low soft tissue contrast on computed tomography images. Magnetic resonance images contain superior soft-tissue contrast information that can be leveraged if both modalities were available for training. Therefore, we developed a cross-modality educed learning approach where MR information that is educed from CT is used to hallucinate MRI and improve CT segmentation. Our approach, called cross-modality educed deep learning segmentation (CMEDL) combines CT and pse…
Beihang University(北京航空航天大学);University of Oxford(牛津大学);The Affiliated Hospital of Qingdao University(青岛大学附属医院)
As Deep Convolutional Neural Networks (DCNNs) have shown robust performance and results in medical image analysis, a number of deep-learning-based tumor detection methods were developed in recent years. Nowadays, the automatic detection of pancreatic tumors using contrast-enhanced Computed Tomography (CT) is widely applied for the diagnosis and staging of pancreatic cancer. Traditional hand-crafted methods only extract low-level features. Normal convolutional neural networks, however, fail to make full use of effective context information, which causes inferior detection results. In this paper…
Kidney structures segmentation is a crucial yet challenging task in the computer-aided diagnosis of surgery-based renal cancer. Although numerous deep learning models have achieved remarkable success in many medical image segmentation tasks, accurate segmentation of kidney structures on computed tomography angiography (CTA) images remains challenging, due to the variable sizes of kidney tumors and the ambiguous boundaries between kidney structures and their surroundings. In this paper, we propose a boundary-aware network (BA-Net) to segment kidneys, kidney tumors, arteries, and veins on CTA sc…
Merlin Plus: A Large-Scale, Multi-Cancer, Image-Mask-Report Dataset
Johns Hopkins University(约翰斯·霍普金斯大学);Harvard Medical School(哈佛医学院);Massachusetts General Hospital(马萨诸塞总医院);Jagiellonian University(雅盖隆大学);Stanford University(斯坦福大学);Warmian-Masurian Cancer Center(瓦尔米亚-马祖里癌症中心);University of California, San Francisco(加利福尼亚大学旧金山分校);Johns Hopkins Medicine(约翰斯·霍普金斯医学)
Enhanced Liver Tumor Detection in CT Images Using 3D U-Net and Bat Algorithm for Hyperparameter Optimization
Department of Mathematics and Statistics, Loyola University Chicago(洛约拉大学芝加哥分校数学与统计学系);Department of Mathematics and Computer Science, Islamic Azad University, Science and Research Branch(伊斯兰 Azad 大学科学与研究分校数学与计算机科学系)
本文提出将 3D U-Net 架构与 Bat Algorithm 结合,通过优化学习率和批大小等超参数实现 CT 图像中肝肿瘤的自动分割,有效提升了分割精度与鲁棒性。
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);University of Southern California(南加利福尼亚大学);Lenovo Research(联想研究院);Lenovo Ltd.(联想有限公司)
Purpose: Automated liver tumor segmentation from Computed Tomography (CT) images is a necessary prerequisite in the interventions of hepatic abnormalities and surgery planning. However, accurate liver tumor segmentation remains challenging due to the large variability of tumor sizes and inhomogeneous texture. Recent advances based on Fully Convolutional Network (FCN) for medical image segmentation drew on the success of learning discriminative pyramid features. In this paper, we propose a Decoupled Pyramid Correlation Network (DPC-Net) that exploits attention mechanisms to fully leverage both …
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);Maastricht University(马斯特里赫特大学);Dana-Farber Cancer Institute(丹娜法伯癌症研究院);Technical University of Munich(慕尼黑工业大学);German Heart Center(德国心脏中心)
Harvard University(哈佛大学);University of Central Florida(中佛罗里达大学)
Lung cancer is the leading cause of cancer related mortality by a significant margin. While new technologies, such as image segmentation, have been paramount to improved detection and earlier diagnoses, there are still significant challenges in treating the disease. In particular, despite an increased number of curative resections, many postoperative patients still develop recurrent lesions. Consequently, there is a significant need for prognostic tools that can more accurately predict a patient's risk for recurrence. In this paper, we explore the use of convolutional neural networks (CNNs) fo…
Imperial College London(帝国理工学院);TECNALIA, Basque Research & Technology Alliance(巴斯克研究与技术联盟TECNALIA);University of the Basque Country(巴斯克大学);Royal Brompton Hospital(皇家布朗普顿医院)
Automatic segmentation of multiple organs and tumors from 3D medical images such as magnetic resonance imaging (MRI) and computed tomography (CT) scans using deep learning methods can aid in diagnosing and treating cancer. However, organs often overlap and are complexly connected, characterized by extensive anatomical variation and low contrast. In addition, the diversity of tumor shape, location, and appearance, coupled with the dominance of background voxels, makes accurate 3D medical image segmentation difficult. In this paper, a novel large-kernel (LK) attention module is proposed to addre…
Lung cancer is one of the deadliest cancers, and in part its effective diagnosis and treatment depend on the accurate delineation of the tumor. Human-centered segmentation, which is currently the most common approach, is subject to inter-observer variability, and is also time-consuming, considering the fact that only experts are capable of providing annotations. Automatic and semi-automatic tumor segmentation methods have recently shown promising results. However, as different researchers have validated their algorithms using various datasets and performance metrics, reliably evaluating these …
South China University of Technology(华南理工大学);Rochester Institute of Technology(罗切斯特理工学院)
We introduce a novel frame-interpolation-based method for slice imputation to improve segmentation accuracy for anisotropic 3D medical images, in which the number of slices and their corresponding segmentation labels can be increased between two consecutive slices in anisotropic 3D medical volumes. Unlike previous inter-slice imputation methods, which only focus on the smoothness in the axial direction, this study aims to improve the smoothness of the interpolated 3D medical volumes in all three directions: axial, sagittal, and coronal. The proposed multitask inter-slice imputation method, in …
A Gradient Mapping Guided Explainable Deep Neural Network for Extracapsular Extension Identification in 3D Head and Neck Cancer Computed Tomography Images
Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, MS, 39762, USA(工业与系统工程系,密苏里州立大学);Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, MS, 39216, USA(放射肿瘤学系,密苏里大学医学中心)
Technical University of Munich(慕尼黑工业大学);University of Zurich(苏黎世大学);Ecole Polytechnique de Montréal(蒙特利尔理工学院);Tel-Aviv University(特拉维夫大学);Imperial College London(帝国理工学院);Hebrew University of Jerusalem(希伯来大学);Radboud University Medical Center(拉德堡德大学医学中心);The University of Montréal Hospital Research Centre(蒙特利尔大学医院研究中心);LMU Munich(慕尼黑大学)
In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with varied sizes and appearances with various lesion-to-background levels (hyper-/hypo-dense), created in collaboration with seven hospitals and research institutions. Seventy-five submitted liver and liv…
The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography
Radboud University Medical Center(拉德堡德大学医学中心);Jeroen Bosch Hospital(杰伦博世医院);University Medical Center Groningen(格罗宁根大学医学中心);Fraunhofer Institute for Digital Medicine MEVIS(弗劳恩霍夫数字医学梅维斯研究所)
SegRap2023: A Benchmark of Organs-at-Risk and Gross Tumor Volume Segmentation for Radiotherapy Planning of Nasopharyngeal Carcinoma
University of Electronic Science and Technology of China(电子科技大学);Sichuan Cancer Hospital & Institute(四川省肿瘤医院(研究所));Shanghai AI Lab(上海人工智能实验室);Canon Medical Systems (China) Co. Ltd.(佳能医疗系统(中国)有限公司);Stockholm University(斯德哥尔摩大学);KTH(瑞典皇家理工学院);Northwestern Polytechnical University(西北工业大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Angiogenesis, the formation of new vessels, is one of the key mechanisms in tumor development and an appealing target for therapy. Non-invasive, high-resolution, high sensitivity, quantitative 3D imaging techniques are required to correctly depict tumor heterogeneous vasculature over time. Ultrafast Doppler was recently introduced and provides an unprecedented combination of resolution, penetration depth and sensitivity without requiring any contrast agents. The technique was further extended to 3D with Ultrafast Doppler Tomography (UFD-T). In this work, UFD-T was applied to the monitoring of …
Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center(美国国立卫生研究院临床中心放射与成像科学部成像生物标志物和计算机辅助诊断实验室);Ping An Insurance Company of China(中国平安保险(集团)股份有限公司)
Lesion segmentation on computed tomography (CT) scans is an important step for precisely monitoring changes in lesion/tumor growth. This task, however, is very challenging since manual segmentation is prohibitively time-consuming, expensive, and requires professional knowledge. Current practices rely on an imprecise substitute called response evaluation criteria in solid tumors (RECIST). Although these markers lack detailed information about the lesion regions, they are commonly found in hospitals' picture archiving and communication systems (PACS). Thus, these markers have the potential to se…
University of Sydney(悉尼大学);Royal Prince Alfred Hospital(阿尔弗雷德王子医院)
The analysis of multi-modality positron emission tomography and computed tomography (PET-CT) images for computer aided diagnosis applications requires combining the sensitivity of PET to detect abnormal regions with anatomical localization from CT. Current methods for PET-CT image analysis either process the modalities separately or fuse information from each modality based on knowledge about the image analysis task. These methods generally do not consider the spatially varying visual characteristics that encode different information across the different modalities, which have different priori…
University of Sydney(悉尼大学);Shanghai Jiao Tong University(上海交通大学)
Multi-modality Fluorodeoxyglucose (FDG) positron emission tomography / computed tomography (PET/CT) has been routinely used in the assessment of common cancers, such as lung cancer, lymphoma, and melanoma. This is mainly attributed to the fact that PET/CT combines the high sensitivity for tumor detection of PET and anatomical information from CT. In PET/CT image assessment, automatic tumor segmentation is an important step, and in recent years, deep learning based methods have become the state-of-the-art. Unfortunately, existing methods tend to over-segment the tumor regions and include region…