The insufficiency of annotated medical imaging scans for cancer makes it challenging to train and validate data-hungry deep learning models in precision oncology. We propose a new richer generative adversarial network for free-form 3D tumor/lesion synthesis in computed tomography (CT) images. The network is composed of a new richer convolutional feature enhanced dilated-gated generator (RicherDG) and a hybrid loss function. The RicherDG has dilated-gated convolution layers to enable tumor-painting and to enlarge perceptive fields; and it has a novel richer convolutional feature association branch to recover multi-scale convolutional features especially from uncertain boundaries between tumor and surrounding healthy tissues. The hybrid loss function, which consists of a diverse range of losses, is designed to aggregate complementary information to improve optimization.
We perform a comprehensive evaluation of the synthesis results on a wide range of public CT image datasets covering the liver, kidney tumors, and lung nodules. The qualitative and quantitative evaluations and ablation study demonstrated improved synthesizing results over advanced tumor synthesis methods.
FreeTumor: Large-Scale Generative Tumor Synthesis in Computed Tomography Images for Improving Tumor Recognition
The Hong Kong University of Science and Technology(香港科技大学);Tencent AI Lab(腾讯AI实验室);Harvard University(哈佛大学);The Chinese University of Hong Kong(香港中文大学);The Third Affiliated Hospital of Southern Medical University(南方医科大学第三附属医院);Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University(中山大学孙逸仙纪念医院);The University of Hong Kong(香港大学);Shenzhen-Hong Kong Collaborative Innovation Research Institute(深港产学研协同创新研究院)
Universal and Extensible Language-Vision Models for Organ Segmentation and Tumor Detection from Abdominal Computed Tomography
City University of Hong Kong(香港城市大学);Johns Hopkins University(约翰斯·霍普金斯大学);University of California, San Francisco(加州大学旧金山分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Chinese University of Hong Kong(香港中文大学);NVIDIA(英伟达)
Mansoura University(曼苏尔大学);South Valley University(南河谷大学);Higher Institute of Engineering and Technology(高等工程技术学院)
The liver is one of the most critical metabolic organs in vertebrates due to its vital functions in the human body, such as detoxification of the blood from waste products and medications. Liver diseases due to liver tumors are one of the most common mortality reasons around the globe. Hence, detecting liver tumors in the early stages of tumor development is highly required as a critical part of medical treatment. Many imaging modalities can be used as aiding tools to detect liver tumors. Computed tomography (CT) is the most used imaging modality for soft tissue organs such as the liver. This …
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology(华中科技大学同济医学院同济医院);Shenzhen-Hong Kong Institute of Brain Science-Shenzhen Fundamental Research Institutions(深港脑科学创新研究院——深圳基础研究机构);United Imaging Research Institute of Innovative Medical Equipment(联影创新医疗装备研究院);Shenzhen Bay Laboratory(深圳湾实验室)
Achieving accurate and automated tumor segmentation plays an important role in both clinical practice and radiomics research. Segmentation in medicine is now often performed manually by experts, which is a laborious, expensive and error-prone task. Manual annotation relies heavily on the experience and knowledge of these experts. In addition, there is much intra- and interobserver variation. Therefore, it is of great significance to develop a method that can automatically segment tumor target regions. In this paper, we propose a deep learning segmentation method based on multimodal positron em…
Accurate visualization of liver tumors and their surrounding blood vessels is essential for noninvasive diagnosis and prognosis prediction of tumors. In medical image segmentation, there is still a lack of in-depth research on the simultaneous segmentation of liver tumors and peritumoral blood vessels. To this end, we collect the first liver tumor, and vessel segmentation benchmark datasets containing 52 portal vein phase computed tomography images with liver, liver tumor, and vessel annotations. In this case, we propose a 3D U-shaped Cross-Attention Network (UCA-Net) that utilizes a tailored …
H2ASeg: Hierarchical Adaptive Interaction and Weighting Network for Tumor Segmentation in PET/CT Images
School of Science, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)理学院);School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院)
University of Sydney(悉尼大学);Shanghai Jiao Tong University(上海交通大学)
Multi-modality Fluorodeoxyglucose (FDG) positron emission tomography / computed tomography (PET/CT) has been routinely used in the assessment of common cancers, such as lung cancer, lymphoma, and melanoma. This is mainly attributed to the fact that PET/CT combines the high sensitivity for tumor detection of PET and anatomical information from CT. In PET/CT image assessment, automatic tumor segmentation is an important step, and in recent years, deep learning based methods have become the state-of-the-art. Unfortunately, existing methods tend to over-segment the tumor regions and include region…
Numerous oncology indications have extensively quantified metabolically active tumors using positron emission tomography (PET) and computed tomography (CT). F-fluorodeoxyglucose-positron emission tomography (FDG-PET) is frequently utilized in clinical practice and clinical drug research to detect and measure metabolically active malignancies. The assessment of tumor burden using manual or computer-assisted tumor segmentation in FDG-PET images is widespread. Deep learning algorithms have also produced effective solutions in this area. However, there may be a need to improve the performance of a…
Cross-Modality Deep Feature Learning for Brain Tumor Segmentation
School of Mechano-Electronic Engineering, Xidian University(西安电子科技大学机电工程学院);Computer Science Department, Aberystwyth University(阿伯里斯特威斯大学计算机科学系);School of Automation, Northwestern Polytechnical University(西北工业大学自动化学院);Deepwise AI Lab(深睿人工智能实验室)
Shanghai AI Lab(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);University of Surrey(萨里大学);University of Electronic Science and Technology of China(电子科技大学);Tongji University(同济大学)
Tumor lesion segmentation is one of the most important tasks in medical image analysis. In clinical practice, Fluorodeoxyglucose Positron-Emission Tomography~(FDG-PET) is a widely used technique to identify and quantify metabolically active tumors. However, since FDG-PET scans only provide metabolic information, healthy tissue or benign disease with irregular glucose consumption may be mistaken for cancer. To handle this challenge, PET is commonly combined with Computed Tomography~(CT), with the CT used to obtain the anatomic structure of the patient. The combination of PET-based metabolic and…
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Cancer is one of the leading causes of death worldwide, and head and neck (H&N) cancer is amongst the most prevalent types. Positron emission tomography and computed tomography are used to detect, segment and quantify the tumor region. Clinically, tumor segmentation is extensively time-consuming and prone to error. Machine learning, and deep learning in particular, can assist to automate this process, yielding results as accurate as the results of a clinician. In this paper, we investigate a vision transformer-based method to automatically delineate H&N tumor, and compare its results to leadin…
Multi-phase Liver Tumor Segmentation with Spatial Aggregation and Uncertain Region Inpainting
Zhejiang University(浙江大学);University of Science and Technology of China(中国科学技术大学);Zhejiang Lab(之江实验室);Ritsumeikan University(立命馆大学);Sir Run Run Shaw Hospital(邵逸夫医院);The First Affiliated Hospital, College of Medicine, Zhejiang University(浙江大学医学院附属第一医院)
Modality-aware Mutual Learning for Multi-modal Medical Image Segmentation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Lenovo Research(联想研究院);Lenovo Ltd.(联想集团有限公司)
Deep Representation Learning of Tissue Metabolome and Computed Tomography Images Annotates Non-invasive Classification and Prognosis Prediction of NSCLC
Kidney structures segmentation is a crucial yet challenging task in the computer-aided diagnosis of surgery-based renal cancer. Although numerous deep learning models have achieved remarkable success in many medical image segmentation tasks, accurate segmentation of kidney structures on computed tomography angiography (CTA) images remains challenging, due to the variable sizes of kidney tumors and the ambiguous boundaries between kidney structures and their surroundings. In this paper, we propose a boundary-aware network (BA-Net) to segment kidneys, kidney tumors, arteries, and veins on CTA sc…
Three-dimensional (3D) kidney parsing on computed tomography angiography (CTA) images is of great clinical significance. Automatic segmentation of kidney, renal tumor, renal vein and renal artery benefits a lot on surgery-based renal cancer treatment. In this paper, we propose a new nnhra-unet network, and use a multi-stage framework which is based on it to segment the multi-structure of kidney and participate in the KiPA2022 challenge.
SimulaMet(SimulaMet研究院);Oslo Metropolitan University(奥斯陆城市大学);UiT The Arctic University of Norway(挪威北极大学)
Head and neck cancers are the fifth most common cancer worldwide, and recently, analysis of Positron Emission Tomography (PET) and Computed Tomography (CT) images has been proposed to identify patients with a prognosis. Even though the results look promising, more research is needed to further validate and improve the results. This paper presents the work done by team MLC for the 2022 version of the HECKTOR grand challenge held at MICCAI 2022. For Task 1, the automatic segmentation task, our approach was, in contrast to earlier solutions using 3D segmentation, to keep it as simple as possible …
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);Maastricht University(马斯特里赫特大学);Dana-Farber Cancer Institute(丹娜法伯癌症研究院);Technical University of Munich(慕尼黑工业大学);German Heart Center(德国心脏中心)
Institute for Anthropomatics and Robotics (IAR), Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院人机交互与机器人研究所);German Cancer Consortium (DKTK)(德国癌症联盟);HIDSS4Health - Helmholtz Information and Data Science School for Health(亥姆霍兹健康信息与数据科学学院(HIDSS4Health));Institute for AI in Medicine (IKIM), University Hospital Essen(埃森大学医院医学人工智能研究所(IKIM));University Hospital Essen(埃森大学医院);West German Cancer Center, Cancer Research Center Cologne Essen (CCCE), University Medicine Essen(埃森大学医学院西德癌症中心、科隆埃森癌症研究中心(CCCE))
Positron Emission Tomography (PET) and Computer Tomography (CT) are routinely used together to detect tumors. PET/CT segmentation models can automate tumor delineation, however, current multimodal models do not fully exploit the complementary information in each modality, as they either concatenate PET and CT data or fuse them at the decision level. To combat this, we propose Mirror U-Net, which replaces traditional fusion methods with multimodal fission by factorizing the multimodal representation into modality-specific branches and an auxiliary multimodal decoder. At these branches, Mirror U…
Convolutional Neural Networks for Segmentation of Malignant Pleural Mesothelioma: Analysis of Probability Map Thresholds (CALGB 30901, Alliance)
The University of Chicago(芝加哥大学);Icelandic Radiation Safety Office(冰岛辐射安全局);Metro Minnesota Community Oncology Research Consortium(明尼苏达大都会社区肿瘤学研究联盟);Duke Cancer Institute(杜克癌症研究所);Duke University(杜克大学);Alliance Statistics and Data Management Center(联盟统计与数据管理中心)
Deep Regression 2D-3D Ultrasound Registration for Liver Motion Correction in Focal Tumor Thermal Ablation
Robarts Research Institute(罗伯茨研究所);Western University(西安大略大学);School of Biomedical Engineering, Western University(西安大略大学生物医学工程学院);Lawson Health Research Institute(劳森健康研究所)