Traditional survival models such as the Cox proportional hazards model are typically based on scalar or categorical clinical features. With the advent of increasingly large image datasets, it has become feasible to incorporate quantitative image features into survival prediction. So far, this kind of analysis is mostly based on radiomics features, i.e. a fixed set of features that is mathematically defined a priori. To capture highly abstract information, it is desirable to learn the feature extraction using convolutional neural networks. However, for tomographic medical images, model training is difficult because on the one hand, only few samples of 3D image data fit into one batch at once and on the other hand, survival loss functions are essentially ordering measures that require large batch sizes. In this work, we show that by simplifying survival analysis to median survival classification, convolutional neural networks can be trained with small batch sizes and learn features that predict survival equally well as end-to-end hazard prediction networks. Our approach outperforms the previous state of the art in a publicly available lung cancer dataset.
University of Technology Sydney(悉尼科技大学);University of Sydney(悉尼大学);Australian Artificial Intelligence Institute(澳大利亚人工智能研究所)
Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied extensively in many real-world applications, including health sectors such as medical image interpretation and disease diagnosis. By combining more modalities that being engaged in the processing of information, multimodal learning can extract better features and improve predictive ability. The conventional methods for lung cancer survival analysis normally utilize c…
Time-driven Survival Analysis from FDG-PET/CT in Non-Small Cell Lung Cancer
Radiology, Department of Surgical Sciences(外科科学系放射学部);Antaros Medical(Antaros医疗);Molecular Imaging and Medical Physics, Department of Surgical Sciences(外科科学系分子成像与医学物理部)
Southern Methodist University(南卫理公会大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);University of Texas Southwestern Medical Center(德克萨斯大学西南医学中心)
Tumor shape is a key factor that affects tumor growth and metastasis. This paper proposes a topological feature computed by persistent homology to characterize tumor progression from digital pathology and radiology images and examines its effect on the time-to-event data. The proposed topological features are invariant to scale-preserving transformation and can summarize various tumor shape patterns. The topological features are represented in functional space and used as functional predictors in a functional Cox proportional hazards model. The proposed model enables interpretable inference ab…
When is 3D Worth It? A Resource-Performance Frontier for CNNs and Transformers in Lung CT
Department of Biomedical Informatics University of Arkansas for Medical Sciences(生物医学信息学系,美国阿肯色大学医学科学分校);Department of Information Science University of Arkansas at Little Rock(信息科学系,美国阿肯色大学小岩分校);Department of Neuroscience University of Arkansas for Medical Sciences(神经科学系,美国阿肯色大学医学科学分校)
A Deep Convolutional Neural Network for Lung Cancer Diagnostic
Universitat Rovira i Virgili(罗维拉-威尔吉利大学);University of Cagliari(卡利亚里大学)
在本文中,我们研究了深度学习技术在医学图像分析问题上诊断肺癌的优势。卷积神经网络(CNN)模型由于其在生成高层次图像表示方面的良好效果而成为模式识别和计算机视觉研究领域的热门。我们提出了一种新的深度学习架构,用于学习高级图像表示,以在医学图像二值分类任务中实现低方差的高分类精度。我们的目标是在深度卷积神经网络的开始学习判别紧凑特征。我们在Kaggle Data Science Bowl 2017(KDSB17)数据集上评估了我们的模型,并将其与Kaggle竞赛中提出的一些相关作品进行了比较。
Foundation Models vs. Radiomics for Lung Computed Tomography: A Benchmark of Feature Extractors, Classification Heads, and Segmentation Choices
Division AI4Health, Carl von Ossietzky Universität Oldenburg(奥尔登堡卡尔·冯·奥西茨基大学AI4Health部门);University Institute for Diagnostic and Interventional Radiology, Klinikum Oldenburg AöR(奥尔登堡医院大学诊断与介入放射学研究所)
Handling Missing Modalities in Multimodal Survival Prediction for Non-Small Cell Lung Cancer
Unit of Artificial Intelligence and Computer Systems, Department of Engineering(人工智能与计算机系统单位,工程系);Università Campus Bio-Medico di Roma(罗马生物医学大学);Department of Diagnostics and Intervention, Radiation Physics, Biomedical Engineering(诊断与介入部门,辐射物理,生物医学工程);Umeå University(乌梅学院);Research Unit of Radiation Oncology, Department of Medicine and Surgery(放射肿瘤研究单位,医学与外科部门);Fondazione Policlinico Universitario Campus Bio-Medico(生物医学大学附属医院基金会);Anatomical Pathology Operative Research Unit(解剖病理学操作研究单位);Research Unit of Anatomical Pathology, Department of Medicine and Surgery(解剖病理学研究单位,医学与外科部门);Department of Medicine and Surgery(医学与外科部门)
Lung squamous cell carcinoma (LSCC) has a high recurrence and metastasis rate. Factors influencing recurrence and metastasis are currently unknown and there are no distinct histopathological or morphological features indicating the risks of recurrence and metastasis in LSCC. Our study focuses on the recurrence prediction of LSCC based on H&E-stained histopathological whole-slide images (WSI). Due to the small size of LSCC cohorts in terms of patients with available recurrence information, standard end-to-end learning with various convolutional neural networks for this task tends to overfit. Al…
MSAD-Net: Multiscale and Spatial Attention-based Dense Network for Lung Cancer Classification
Computer Science and Engineering Department, NIIT University, Jaipur, India(尼特大学计算机科学与工程系,印度斋普尔);CSE department, Christ (Deemed to be University), Bangalore, India(基督大学(认定为大学)计算机科学与工程系,印度班加罗尔);Faculty of Computing, Engineering and the Built Environment, Birmingham City University, UK(伯明翰城市大学计算、工程与建筑环境学院,英国)
Automatic Pulmonary Nodule Detection in CT Scans Using Convolutional Neural Networks Based on Maximum Intensity Projection
University of Groningen, University Medical Center Groningen(格罗宁根大学医学中心);Tianjin Medical University Cancer Institute and Hospital(天津医科大学肿瘤医院);University of Twente(特温特大学)
School of Biomedical Engineering and Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与影像科学学院);BioMedIA, Department of Computing, Imperial College London(帝国理工学院计算系生物医学影像与数据分析中心);Department of Radiology, University College London(伦敦大学学院放射学系);The Royal Brompton & Harefield NHS Foundation Trust(皇家布朗普顿和哈菲尔德英国国民保健信托基金会);Technical University of Munich(慕尼黑工业大学);Helmholtz Center Munich(亥姆霍兹慕尼黑中心)
Convolutional Neural Networks (CNNs) are widely used for image classification in a variety of fields, including medical imaging. While most studies deploy cross-entropy as the loss function in such tasks, a growing number of approaches have turned to a family of contrastive learning-based losses. Even though performance metrics such as accuracy, sensitivity and specificity are regularly used for the evaluation of CNN classifiers, the features that these classifiers actually learn are rarely identified and their effect on the classification performance on out-of-distribution test samples is ins…
Cancer is the uncontrollable cell division of abnormal cells inside the human body, which can spread to other body organs. It is one of the non-communicable diseases (NCDs) and NCDs accounts for 71% of total deaths worldwide whereas lung cancer is the second most diagnosed cancer after female breast cancer. Cancer survival rate of lung cancer is only 19%. There are various methods for the diagnosis of lung cancer, such as X-ray, CT scan, PET-CT scan, bronchoscopy and biopsy. However, to know the subtype of lung cancer based on the tissue type H and E staining is widely used, where the staining…
Chest radiography is one of the most common types of diagnostic radiology exams, which is critical for screening and diagnosis of many different thoracic diseases. Specialized algorithms have been developed to detect several specific pathologies such as lung nodule or lung cancer. However, accurately detecting the presence of multiple diseases from chest X-rays (CXRs) is still a challenging task. This paper presents a supervised multi-label classification framework based on deep convolutional neural networks (CNNs) for predicting the risk of 14 common thoracic diseases. We tackle this problem …
CT-CLIP Representations for Multimodal Lung Cancer Survival Prediction
Chalmers University of Technology(查尔姆斯理工大学);Umeå University(于默奥大学);Sahlgrenska University Hospital(萨尔格伦斯卡大学医院);Sahlgrenska Academy at Gothenburg University(哥德堡大学萨尔格伦斯卡学院)
Pathology slides of lung malignancies are classified using resource-frugal convolution neural networks (CNNs) that may be deployed on mobile devices. In particular, the challenging task of distinguishing adenocarcinoma (LUAD) and squamous-cell carcinoma (LUSC) lung cancer subtypes is approached in two stages. First, whole-slide histopathology images are downsampled to a size too large for CNN analysis but large enough to retain key anatomic detail. The downsampled images are decomposed into smaller square tiles, which are sifted based on their image entropies. A lightweight CNN produces tile-l…
Magnetic resonance delta radiomics to track radiation response in lung tumors receiving stereotactic MRI-guided radiotherapy
Mass General Brigham(麻省总医院布里格姆医疗系统);Harvard Medical School(哈佛医学院);Dana-Farber Cancer Institute(丹娜-法伯癌症研究所);Harvard T.H. Chan School of Public Health(哈佛大学陈曾熙公共卫生学院);Maastricht University(马斯特里赫特大学)
Technische Hochschule Ingolstadt(英戈尔施塔特应用技术大学);Klinikum Ingolstadt(英戈尔施塔特医院);University of Regensburg(雷根斯堡大学);University Hospital Regensburg(雷根斯堡大学医院);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)
Attention-based multiple instance learning (AMIL) algorithms have proven to be successful in utilizing gigapixel whole-slide images (WSIs) for a variety of different computational pathology tasks such as outcome prediction and cancer subtyping problems. We extended an AMIL approach to the task of survival prediction by utilizing the classical Cox partial likelihood as a loss function, converting the AMIL model into a nonlinear proportional hazards model. We applied the model to tissue microarray (TMA) slides of 330 lung cancer patients. The results show that AMIL approaches can handle very sma…
School of Professional Studies(专业研究学院);Northwestern University(西北大学)
Artificial intelligence (AI) is disrupting the medical field as advances in modern technology allow common household computers to learn anatomical and pathological features that distinguish between healthy and disease with the accuracy of highly specialized, trained physicians. Computer vision AI applications use medical imaging, such as lung chest X-Rays (LCXRs), to facilitate diagnoses by providing second-opinions in addition to a physician's or radiologist's interpretation. Considering the advent of the current Coronavirus disease (COVID-19) pandemic, LCXRs may provide rapid insights to ind…
Deep Learning versus Classical Regression for Brain Tumor Patient Survival Prediction
Institute for Surgical Technology and Biomechanics, University of Bern(伯尔尼大学外科技术与生物力学研究所);University Clinic for Radio-oncology, Inselspital, Bern University Hospital, University of Bern(伯尔尼大学伯尔尼大学医院因塞尔医院放射肿瘤学大学诊所);Support Center for Advanced Neuroimaging, University Institute of Diagnostic and Interventional Neuroradiology, Inselspital, University of Bern(伯尔尼大学因塞尔医院诊断与介入神经放射学大学研究所高级神经成像支持中心)
Chest radiographs are used for the diagnosis of multiple critical illnesses (e.g., Pneumonia, heart failure, lung cancer), for this reason, systems for the automatic or semi-automatic analysis of these data are of particular interest. An efficient analysis of large amounts of chest radiographs can aid physicians and radiologists, ultimately allowing for better medical care of lung-, heart- and chest-related conditions. We propose a novel Discrete Wavelet Transform (DWT)-based method for the efficient identification and encoding of visual information that is typically lost in the down-sampling …
From Cells to Survival: Hierarchical Analysis of Cell Inter-Relations in Multiplex Microscopy for Lung Cancer Prognosis
Department of Information Technology, SciLifeLab, Uppsala University(信息科技系、SciLifeLab、乌普萨拉大学);PAICON GmbH(PAICON公司);Department of Immunology, Genetics and Pathology, Uppsala University(免疫学、遗传学和病理学系、乌普萨拉大学);Molecular Oncology Group, Vall d'Hebron Institute of Oncology(分子肿瘤学组、瓦伦·德·霍布伦肿瘤研究所);Vall d'Hebron Institute of Research(瓦伦·德·霍布伦研究所)
MESAHA-Net: Multi-Encoders based Self-Adaptive Hard Attention Network with Maximum Intensity Projections for Lung Nodule Segmentation in CT Scan
Department of Computer Science and Engineering, Seoul National University(计算机科学与工程系,首尔国立大学);Center for Artificial Intelligence in Medicine and Imaging, HealthHub Co. Ltd.(医学与影像人工智能中心,HealthHub公司);Department of Electrical and Computer Engineering, The University of Alabama(电气与计算机工程系,阿拉巴马大学);Department of Electrical Engineering, COMSATS University Islamabad(电气工程系,COMSATS大学伊斯兰堡分校)
Maastricht University Medical Centre+(马斯特里赫特大学医学中心+)
Radiomics is an active area of research focusing on high throughput feature extraction from medical images with a wide array of applications in clinical practice, such as clinical decision support in oncology. However, noise in low dose computed tomography (CT) scans can impair the accurate extraction of radiomic features. In this article, we investigate the possibility of using deep learning generative models to improve the performance of radiomics from low dose CTs. We used two datasets of low dose CT scans -NSCLC Radiogenomics and LIDC-IDRI - as test datasets for two tasks - pre-treatment s…
University of Michigan(密歇根大学);Imbio LLC(Imbio有限责任公司)
Early detection of lung cancer is critical for improvement of patient survival. To address the clinical need for efficacious treatments, genetically engineered mouse models (GEMM) have become integral in identifying and evaluating the molecular underpinnings of this complex disease that may be exploited as therapeutic targets. Assessment of GEMM tumor burden on histopathological sections performed by manual inspection is both time consuming and prone to subjective bias. Therefore, an interplay of needs and challenges exists for computer-aided diagnostic tools, for accurate and efficient analys…
LNDb: A Lung Nodule Database on Computed Tomography
Institute for Systems and Computer Engineering, Technology and Science (INESC TEC)(系统与计算机工程、技术与科学研究所(INESC TEC));Faculty of Engineering of the University of Porto (FEUP)(波尔图大学工程学院(FEUP));University of Trás-os-Montes e Alto Douro (UTAD)(山后-上杜罗大学(UTAD));Centro Hospitalar e Universitário de S. João(圣若昂大学医院中心);Faculty of Medicine of the University of Porto (FMUP)(波尔图大学医学院(FMUP))
Harvard University(哈佛大学);University of Central Florida(中佛罗里达大学)
Lung cancer is the leading cause of cancer related mortality by a significant margin. While new technologies, such as image segmentation, have been paramount to improved detection and earlier diagnoses, there are still significant challenges in treating the disease. In particular, despite an increased number of curative resections, many postoperative patients still develop recurrent lesions. Consequently, there is a significant need for prognostic tools that can more accurately predict a patient's risk for recurrence. In this paper, we explore the use of convolutional neural networks (CNNs) fo…
Time-Conditioned and Multi-Time Survival Prediction from 2D PET/CT Projections in Lung Cancer
Radiology, Department of Surgical Sciences, Uppsala University(乌普萨拉大学外科学系放射科);National Academic Infrastructure for Supercomputing (NAISS), Linköping University(林雪平大学国家学术超级计算基础设施);Antaros Medical;SciLifeLab, Uppsala University(乌普萨拉大学SciLifeLab)
Gated-Dilated Networks for Lung Nodule Classification in CT scans
Monash University Malaysia(莫纳什大学马来西亚分校);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);CNRS(法国国家科学研究中心);Singapore Eye Research Institute(新加坡眼科研究所);University of Oklahoma(俄克拉荷马大学)
Classification based deep learning models for lung cancer and disease using medical images
Laboratory for Artificial Intelligence of Personalized Medicine, School of Artificial Intelligence, Guilin University of Electronic Technology(人工智能个性化医学实验室,人工智能学院,桂林电子科技大学);The Laboratory for Imagery, Vision and Artificial Intelligence, Ecole de Technologie Superieure(影像、视觉与人工智能实验室,蒙特利尔理工学院)
Medical Imaging Center, Vingroup Big Data Institute(Vingroup大数据研究院医学影像中心);College of Engineering & Computer Science, VinUniversity(VinUniversity工程与计算机科学学院)
Chest radiograph (CXR) interpretation in pediatric patients is error-prone and requires a high level of understanding of radiologic expertise. Recently, deep convolutional neural networks (D-CNNs) have shown remarkable performance in interpreting CXR in adults. However, there is a lack of evidence indicating that D-CNNs can recognize accurately multiple lung pathologies from pediatric CXR scans. In particular, the development of diagnostic models for the detection of pediatric chest diseases faces significant challenges such as (i) lack of physician-annotated datasets and (ii) class imbalance …
COMSATS University Islamabad(伊斯兰堡COMSATS大学);Bacha Khan University(巴查汗大学);Chung-Ang University(中央大学);University of Malaya(马来亚大学);University Malaysia Sabah(马来西亚沙巴大学);Institute of Space Technology(空间技术研究所)
The ongoing COVID-19 pandemic has already taken millions of lives and damaged economies across the globe. Most COVID-19 deaths and economic losses are reported from densely crowded cities. It is comprehensible that the effective control and prevention of epidemic/pandemic infectious diseases is vital. According to WHO, testing and diagnosis is the best strategy to control pandemics. Scientists worldwide are attempting to develop various innovative and cost-efficient methods to speed up the testing process. This paper comprehensively evaluates the applicability of the recent top ten state-of-th…
Concordia Institute for Information Systems Engineering, Concordia University(康考迪亚大学信息系统工程研究所);Sunnybrook Health Sciences Centre, University of Toronto(多伦多大学桑尼布鲁克健康科学中心);McGill University Health Center- Research Institute(麦吉尔大学健康中心研究所);Babak Imaging Center(巴布克影像中心);Department of Electrical and Computer Engineering, University of Toronto(多伦多大学电气与计算机工程系)
Lung diseases including infections such as Pneumonia, Tuberculosis, and novel Coronavirus (COVID-19), together with Lung Cancer are significantly widespread and are, typically, considered life threatening. In particular, lung cancer is among the most common and deadliest cancers with a low 5-year survival rate. Timely diagnosis of lung cancer is, therefore, of paramount importance as it can save countless lives. In this regard, deep learning radiomics solutions have the promise of extracting the most useful features on their own in an end-to-end fashion without having access to the annotated b…
This review presents a comprehensive study on the role of GANs in addressing the challenges related to COVID-19 data scarcity and diagnosis. It is the first review that summarizes the different GANs methods and the lungs images datasets for COVID-19. It attempts to answer the questions related to applications of GANs, popular GAN architectures, frequently used image modalities, and the availability of source code. This review included 57 full-text studies that reported the use of GANs for different applications in COVID-19 lungs images data. Most of the studies (n=42) used GANs for data augmen…
Qatar University(卡塔尔大学);Universiti Kebangsaan Malaysia(马来西亚国民大学)
Novel Coronavirus disease (COVID-19) is an extremely contagious and quickly spreading Coronavirus infestation. Severe Acute Respiratory Syndrome (SARS) and Middle East Respiratory Syndrome (MERS), which outbreak in 2002 and 2011, and the current COVID-19 pandemic are all from the same family of coronavirus. This work aims to classify COVID-19, SARS, and MERS chest X-ray (CXR) images using deep Convolutional Neural Networks (CNNs). A unique database was created, so-called QU-COVID-family, consisting of 423 COVID-19, 144 MERS, and 134 SARS CXR images. Besides, a robust COVID-19 recognition syste…
Peng Cheng Laboratory(鹏城实验室);Xi’an Jiaotong University(西安交通大学);Shanghai AI Laboratory(上海人工智能实验室);Shenzhen Peini Digital Technology Co., Ltd.(深圳佩妮数字科技有限公司);University of Technology Sydney(悉尼科技大学)
This paper focuses on the task of survival time analysis for lung cancer. Although much progress has been made in this problem in recent years, the performance of existing methods is still far from satisfactory. Traditional and some deep learning-based survival time analyses for lung cancer are mostly based on textual clinical information such as staging, age, histology, etc. Unlike existing methods that predicting on the single modality, we observe that a human clinician usually takes multimodal data such as text clinical data and visual scans to estimate survival time. Motivated by this, in …
School of Information Technology(信息技术学院);University of Cincinnati(辛辛那提大学)
Lung cancer is the leading cause of death among different types of cancers. Every year, the lives lost due to lung cancer exceed those lost to pancreatic, breast, and prostate cancer combined. The survival rate for lung cancer patients is very low compared to other cancer patients due to late diagnostics. Thus, early lung cancer diagnostics is crucial for patients to receive early treatments, increasing the survival rate or even becoming cancer-free. This paper proposed a deep-learning model for early lung cancer prediction and diagnosis from Computed Tomography (CT) scans. The proposed mode a…
xCG: Explainable Cell Graphs for Survival Prediction in Non-Small Cell Lung Cancer
Aignostics, Germany(艾格诺斯蒂克斯公司(德国));Technische Universität Berlin, Germany(柏林工业大学);BIFOLD – Berlin Institute for the Foundations of Learning and Data, Germany(柏林学习与数据基础研究所);Konrad Zuse School of Excellence in Learning and Intelligent Systems (ELIZA), Germany(康拉德·楚泽学习与智能系统卓越学院);Charité – Universitätsmedizin Berlin, Germany(柏林夏里特医学院);Ludwig-Maximilians-Universität München, Germany(慕尼黑大学);Bavarian Cancer Research Center (BZKF), Germany(巴伐利亚癌症研究中心);Max-Planck Institute for Informatics, Germany(马克斯·普朗克信息学研究所);Korea University, Republic of Korea(高丽大学)
Recent studies have shown that lung cancer screening using annual low-dose computed tomography (CT) reduces lung cancer mortality by 20% compared to traditional chest radiography. Therefore, CT lung screening has started to be used widely all across the world. However, analyzing these images is a serious burden for radiologists. The number of slices in a CT scan can be up to 600. Therefore, computer-aided-detection (CAD) systems are very important for faster and more accurate assessment of the data. In this study, we proposed a framework that analyzes CT lung screenings using convolutional neu…
Idiopathic Pulmonary Fibrosis (IPF) is an inexorably progressive fibrotic lung disease with a variable and unpredictable rate of progression. CT scans of the lungs inform clinical assessment of IPF patients and contain pertinent information related to disease progression. In this work, we propose a multi-modal method that uses neural networks and memory banks to predict the survival of IPF patients using clinical and imaging data. The majority of clinical IPF patient records have missing data (e.g. missing lung function tests). To this end, we propose a probabilistic model that captures the de…
University of Maryland Baltimore County(马里兰大学巴尔的摩县分校)
We present a hybrid algorithm to estimate lung nodule malignancy that combines imaging biomarkers from Radiologist's annotation with image classification of CT scans. Our algorithm employs a 3D Convolutional Neural Network (CNN) as well as a Random Forest in order to combine CT imagery with biomarker annotation and volumetric radiomic features. We analyze and compare the performance of the algorithm using only imagery, only biomarkers, combined imagery + biomarkers, combined imagery + volumetric radiomic features and finally the combination of imagery + biomarkers + volumetric features in orde…
Novel Radiomic Feature for Survival Prediction of Lung Cancer Patients using Low-Dose CBCT Images
Indian Institute of Technology Kharagpur(印度理工学院卡拉格普尔分校);Tata Medical Center(塔塔医学中心);Arden Cancer Centre(雅顿癌症中心);University Hospitals Coventry and Warwickshire(考文垂与沃里克郡大学医院)
IEO European Institute of Oncology IRCCS(IEO欧洲肿瘤研究所IRCCS);Technical University of Munich(慕尼黑工业大学);University of Milan(米兰大学);Istituto Imaging della Svizzera Italiana (IIMSI)(瑞士意大利语区成像研究所(IIMSI));Università della Svizzera italiana(瑞士意大利语区大学);Bern University Hospital(伯尔尼大学医院);University of Bern(伯尔尼大学)
Lesion segmentation is a crucial step of the radiomic workflow. Manual segmentation requires long execution time and is prone to variability, impairing the realisation of radiomic studies and their robustness. In this study, a deep-learning automatic segmentation method was applied on computed tomography images of non-small-cell lung cancer patients. The use of manual vs automatic segmentation in the performance of survival radiomic models was assessed, as well. METHODS A total of 899 NSCLC patients were included (2 proprietary: A and B, 1 public datasets: C). Automatic segmentation of lung le…