Diagnosis and treatment of multiple pulmonary nodules are clinically important but challenging. Prior studies on nodule characterization use solitary-nodule approaches on multiple nodular patients, which ignores the relations between nodules. In this study, we propose a multiple instance learning (MIL) approach and empirically prove the benefit to learn the relations between multiple nodules. By treating the multiple nodules from a same patient as a whole, critical relational information between solitary-nodule voxels is extracted. To our knowledge, it is the first study to learn the relations between multiple pulmonary nodules. Inspired by recent advances in natural language processing (NLP) domain, we introduce a self-attention transformer equipped with 3D CNN, named {NoduleSAT}, to replace typical pooling-based aggregation in multiple instance learning. Extensive experiments on lung nodule false positive reduction on LUNA16 database, and malignancy classification on LIDC-IDRI database, validate the effectiveness of the proposed method.
Dali University（大理大学）；Liuzhou Vocational & Technical College（柳州职业技术学院）；The Second Xiangya Hospital of Central South University（中南大学湘雅二医院）；Hunan Key Laboratory of Early Diagnosis and Precise Treatment of Lung Cancer（湖南省肺癌早期诊断与精准治疗重点实验室）；Early-Stage Lung Cancer Center（早期肺癌中心）
Detection of pulmonary nodules by CT is used for screening lung cancer in early stages.omputer aided diagnosis (CAD) based on deep-learning method can identify the suspected areas of pulmonary nodules in CT images, thus improving the accuracy and efficiency of CT diagnosis. The accuracy and robustness of deep learning models. Method:In this paper, we explore (1) the data augmentation method based on the generation model and (2) the model structure improvement method based on the embedding mechanism. Two strategies have been introduced in this study: a new data augmentation method and a embeddi…
Eurecat Centre Tecnològic de Catalunya（加泰罗尼亚技术中心）；Universitat Pompeu Fabra（庞培法布拉大学）；Vall d'Hebron University Hospital（瓦尔德希布伦大学医院）；ICREA（加泰罗尼亚高级研究院）
We address the problem of supporting radiologists in the longitudinal management of lung cancer. Therefore, we proposed a deep learning pipeline, composed of four stages that completely automatized from the detection of nodules to the classification of cancer, through the detection of growth in the nodules. In addition, the pipeline integrated a novel approach for nodule growth detection, which relied on a recent hierarchical probabilistic U-Net adapted to report uncertainty estimates. Also, a second novel method was introduced for lung cancer nodule classification, integrating into a two stre…
Candidate generation, the first stage for most computer aided detection (CAD) systems, rapidly scans the entire image data for any possible abnormality locations, while the subsequent stages of the CAD system refine the candidates list to determine the most probable or significant of these candidates. The candidate generator creates a list of the locations and provides a size estimate for each candidate. A multiscale scale-normalized Laplacian of Gaussian (LoG) filtering method for detecting pulmonary nodules in whole-lung CT scans, presented in this paper, achieves a high sensitivity for both…
Wuhan University（武汉大学）；Hubei Luojia Laboratory（湖北珞珈实验室）；The University of Electro-Communications（电气通信大学）；JD Explore Academy（京东探索研究院）；Dianei Technology（点内科技）；Shanghai Jiao Tong University（上海交通大学）；EPFL（洛桑联邦理工学院）
Lung cancer is the leading cause of cancer death worldwide. The best solution for lung cancer is to diagnose the pulmonary nodules in the early stage, which is usually accomplished with the aid of thoracic computed tomography (CT). As deep learning thrives, convolutional neural networks (CNNs) have been introduced into pulmonary nodule detection to help doctors in this labor-intensive task and demonstrated to be very effective. However, the current pulmonary nodule detection methods are usually domain-specific, and cannot satisfy the requirement of working in diverse real-world scenarios. To a…
Eurecat, Centre Tecnòlogic de Catalunya（加泰罗尼亚技术中心Eurecat）；Universitat Pompeu Fabra（庞培法布拉大学）；Vall d’Hebron University Hospital（瓦尔德希伯伦大学医院）；ICREA（加泰罗尼亚研究与高级研究院）
Nodule malignancy assessment is a complex, time-consuming and error-prone task. Current clinical practice requires measuring changes in size and density of the nodule at different time-points. State of the art solutions rely on 3D convolutional neural networks built on pulmonary nodules obtained from single CT scan per patient. In this work, we propose a two-stream 3D convolutional neural network that predicts malignancy by jointly analyzing two pulmonary nodule volumes from the same patient taken at different time-points. Best results achieve 77% of F1-score in test with an increment of 9% an…
Lung cancer has the highest mortality rate of deadly cancers in the world. Early detection is essential to treatment of lung cancer. However, detection and accurate diagnosis of pulmonary nodules depend heavily on the experiences of radiologists and can be a heavy workload for them. Computer-aided diagnosis (CAD) systems have been developed to assist radiologists in nodule detection and diagnosis, greatly easing the workload while increasing diagnosis accuracy. Recent development of deep learning, greatly improved the performance of CAD systems. However, lack of model reliability and interpret…
The City College of New York（纽约城市学院）；UMass CICS（马萨诸塞大学阿默斯特分校信息与计算机科学学院）；Google AI（谷歌人工智能）；Memorial Sloan-Kettering Cancer Center（纪念斯隆-凯特琳癌症中心）
Accurate detection of pulmonary nodules with high sensitivity and specificity is essential for automatic lung cancer diagnosis from CT scans. Although many deep learning-based algorithms make great progress for improving the accuracy of nodule detection, the high false positive rate is still a challenging problem which limited the automatic diagnosis in routine clinical practice. In this paper, we propose a novel pulmonary nodule detection framework based on a 3D Feature Pyramid Network (3DFPN) to improve the sensitivity of nodule detection by employing multi-scale features to increase the res…
Scale-aware Test-time Click Adaptation for Pulmonary Nodule and Mass Segmentation
Wuhan University（武汉大学）；Artificial Intelligence Institute of Wuhan University（武汉大学人工智能研究院）；Swiss Federal Institute of Technology Lausanne (EPFL)（洛桑联邦理工学院（EPFL））；Dianei Technology（点内科技）
Convolutional neural networks (CNNs) have been demonstrated to be highly effective in the field of pulmonary nodule detection. However, existing CNN based pulmonary nodule detection methods lack the ability to capture long-range dependencies, which is vital for global information extraction. In computer vision tasks, non-local operations have been widely utilized, but the computational cost could be very high for 3D computed tomography (CT) images. To address this issue, we propose a long short slice-aware network (LSSANet) for the detection of pulmonary nodules. In particular, we develop a ne…
Eurecat, Centre Tecnològic de Catalunya（加泰罗尼亚技术中心 Eurecat）；Universitat Pompeu Fabra（庞培法布拉大学）；ICREA
The early identification of malignant pulmonary nodules is critical for better lung cancer prognosis and less invasive chemo or radio therapies. Nodule malignancy assessment done by radiologists is extremely useful for planning a preventive intervention but is, unfortunately, a complex, time-consuming and error-prone task. This explains the lack of large datasets containing radiologists malignancy characterization of nodules. In this article, we propose to assess nodule malignancy through 3D convolutional neural networks and to integrate it in an automated end-to-end existing pipeline of lung …
Yandex School of Data Analysis（Yandex数据分析学院）；Tel Aviv University（特拉维夫大学）
Content-based retrieval supports a radiologist decision making process by presenting the doctor the most similar cases from the database containing both historical diagnosis and further disease development history. We present a deep learning system that transforms a 3D image of a pulmonary nodule from a CT scan into a low-dimensional embedding vector. We demonstrate that such a vector representation preserves semantic information about the nodule and offers a viable approach for content-based image retrieval (CBIR). We discuss the theoretical limitations of the available datasets and overcome …
Application of Computer Deep Learning Model in Diagnosis of Pulmonary Nodules
University of California, Davis（加州大学戴维斯分校）；University of Washington（华盛顿大学）；Northern Arizona University（北亚利桑那大学）；Arizona State University（亚利桑那州立大学）；University of Pennsylvania（宾夕法尼亚大学）；University of California San Diego（加州大学圣迭戈分校）
Dalian University of Technology（大连理工大学）；Key Laboratory for Ubiquitous Network and Service Software of Liaoning Province（辽宁省泛在网络与服务软件重点实验室）
More and more attention has been paid to the segmentation of pulmonary nodules. Among the current methods based on deep learning, 3D segmentation methods directly input 3D images, which takes up a lot of memory and brings huge computation. However, most of the 2D segmentation methods with less parameters and calculation have the problem of lacking spatial relations between slices, resulting in poor segmentation performance. In order to solve these problems, we propose an adjacent slice feature guided 2.5D network. In this paper, we design an adjacent slice feature fusion model to introduce inf…
Eurecat Centre Tecnològic de Catalunya（加泰罗尼亚埃urecat技术中心）；Universitat Pompeu Fabra（庞培法布拉大学）；Vall d’Hebron University Hospital（瓦尔德希伯伦大学医院）；ICREA（加泰罗尼亚研究与高等研究院）
Lung cancer follow-up is a complex, error prone, and time consuming task for clinical radiologists. Several lung CT scan images taken at different time points of a given patient need to be individually inspected, looking for possible cancerogenous nodules. Radiologists mainly focus their attention in nodule size, density, and growth to assess the existence of malignancy. In this study, we present a novel method based on a 3D siamese neural network, for the re-identification of nodules in a pair of CT scans of the same patient without the need for image registration. The network was integrated …
The City College of New York（纽约城市学院）；UMass CICS（马萨诸塞大学信息与计算机科学学院）；Google AI（谷歌人工智能）；Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）
Accurate detection of pulmonary nodules with high sensitivity and specificity is essential for automatic lung cancer diagnosis from CT scans. Although many deep learning-based algorithms make great progress for improving the accuracy of nodule detection, the high false positive rate is still a challenging problem which limits the automatic diagnosis in routine clinical practice. Moreover, the CT scans collected from multiple manufacturers may affect the robustness of Computer-aided diagnosis (CAD) due to the differences in intensity scales and machine noises. In this paper, we propose a novel …
CPLOYO: A Pulmonary Nodule Detection Model with Multi-Scale Feature Fusion and Nonlinear Feature Learning
Tongji Hospital, School of Medicine, Tongji University（同济大学医学院附属同济医院）；Shanghai Pulmonology Hospital, School of Medicine, Tongji University（同济大学医学院附属上海肺科医院）；Carnegie Mellon University（卡内基梅隆大学）
MSDet: Receptive Field Enhanced Multiscale Detection for Tiny Pulmonary Nodule
College of Computer Science and Artificial Intelligence, Southwest Minzu University（西南民族大学计算机科学与人工智能学院）；School of Intelligent System Engineering, Sun Yat-sen University（中山大学智能系统工程学院）；University of Warwick（华威大学）；Australian National University（澳大利亚国立大学）；School of Computer Science and Technology, Beijing Jiaotong University（北京交通大学计算机科学与技术学院）；University of Toronto（多伦多大学）；University of Adelaide（阿德莱德大学）；La Trobe University（拉筹伯大学）
Shanghai Jiao Tong University（上海交通大学）；INSA Lyon（里昂国立应用科学学院）；CNRS（法国国家科学研究中心）；INSERM（法国国家健康与医学研究院）；Université de Lyon（里昂大学）；Guizhou University（贵州大学）；Shanghai Chest Hospital（上海市胸科医院）
To investigate whether the pleurae, airways and vessels surrounding a nodule on non-contrast computed tomography (CT) can discriminate benign and malignant pulmonary nodules. The LIDC-IDRI dataset, one of the largest publicly available CT database, was exploited for study. A total of 1556 nodules from 694 patients were involved in statistical analysis, where nodules with average scorings <3 and >3 were respectively denoted as benign and malignant. Besides, 339 nodules from 113 patients with diagnosis ground-truth were independently evaluated. Computer algorithms were developed to segment pulmo…
Otto von Guericke University Magdeburg（马格德堡奥托·冯·格里克大学）
Pulmonary cancer is one of the most commonly diagnosed and fatal cancers and is often diagnosed by incidental findings on computed tomography. Automated pulmonary nodule detection is an essential part of computer-aided diagnosis, which is still facing great challenges and difficulties to quickly and accurately locate the exact nodules' positions. This paper proposes a dual skip connection upsampling strategy based on Dual Path network in a U-Net structure generating multiscale feature maps, which aims to minimize the ratio of false positives and maximize the sensitivity for lesion detection of…
Shanghai Jiao Tong University（上海交通大学）；Imperial College London（帝国理工学院）；Shanghai Chest Hospital（上海市胸科医院）；Shanghai Center for Brain Science and Brain-Inspired Technology（上海脑科学与类脑研究中心）
The LIDC-IDRI database is the most popular benchmark for lung cancer prediction. However, with subjective assessment from radiologists, nodules in LIDC may have entirely different malignancy annotations from the pathological ground truth, introducing label assignment errors and subsequent supervision bias during training. The LIDC database thus requires more objective labels for learning-based cancer prediction. Based on an extra small dataset containing 180 nodules diagnosed by pathological examination, we propose to re-label LIDC data to mitigate the effect of original annotation bias verifi…
Alleviating Hyperparameter-Tuning Burden in SVM Classifiers for Pulmonary Nodules Diagnosis with Multi-Task Bayesian Optimization
Yau Mathematical Sciences Center Tsinghua University（姚数学科学中心清华大学）；The First Affiliated Hospital of Guangzhou Medical University（广州医科大学第一附属医院）；China State Key Laboratory of Respiratory Disease（中国呼吸疾病国家重点实验室）；Academy of Mathematics and Systems Science Chinese Academy of Sciences（数学科学学院中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Department of Thoracic Surgery and Oncology The First Affiliated Hospital of Guangzhou Medical University（胸外科与肿瘤科广州医科大学第一附属医院）
Sir Run Run Shaw Hospital（邵逸夫医院）；School of Medicine, Zhejiang University（浙江大学医学院）；School of Computer Science and Technology, Hangzhou Dianzi University（杭州电子科技大学计算机科学与技术学院）；College of Medicine, Zhejiang University（浙江大学医学院）
Automatic pulmonary nodules classification is significant for early diagnosis of lung cancers. Recently, deep learning techniques have enabled remarkable progress in this field. However, these deep models are typically of high computational complexity and work in a black-box manner. To combat these challenges, in this work, we aim to build an efficient and (partially) explainable classification model. Specially, we use \emph{neural architecture search} (NAS) to automatically search 3D network architectures with excellent accuracy/speed trade-off. Besides, we use the convolutional block attenti…
The mortality of lung cancer has ranked high among cancers for many years. Early detection of lung cancer is critical for disease prevention, cure, and mortality rate reduction. However, existing detection methods on pulmonary nodules introduce an excessive number of false positive proposals in order to achieve high sensitivity, which is not practical in clinical situations. In this paper, we propose the multi-head detection and spatial squeeze-and-attention network, MHSnet, to detect pulmonary nodules, in order to aid doctors in the early diagnosis of lung cancers. Specifically, we first intr…
Longitudinal Multimodal Transformer Integrating Imaging and Latent Clinical Signatures From Routine EHRs for Pulmonary Nodule Classification
Vanderbilt University（范德堡大学）；Siemens Healthineers（西门子医疗）；Saint Luke’s Mid America Heart Institute（圣卢克中美洲心脏研究所）；Vanderbilt University Medical Center（范德堡大学医学中心）
University of Patras（帕特雷大学）；School of Medicine（医学院）；Laboratory of Nuclear Medicine（核医学实验室）
Lung Cancer is the most common cause of cancer-related death worldwide. Early and automatic diagnosis of Solitary Pulmonary Nodules (SPN) in Computer Tomography (CT) chest scans can provide early treatment as well as doctor liberation from time-consuming procedures. Deep Learning has been proven as a popular and influential method in many medical imaging diagnosis areas. In this study, we consider the problem of diagnostic classification between benign and malignant lung nodules in CT images derived from a PET/CT scanner. More specifically, we intend to develop experimental Convolutional Neura…
Shanghai Jiao Tong University（上海交通大学）；Shanghai Institute for Advanced Communication and Data Science（上海先进通信与数据科学研究院）；AI Institute Shanghai Jiao Tong University（上海交通大学人工智能研究院）；Shanghai Chest Hospital（上海市胸科医院）；Shanghai General Hospital（上海市第一人民医院）
Follow-up serves an important role in the management of pulmonary nodules for lung cancer. Imaging diagnostic guidelines with expert consensus have been made to help radiologists make clinical decision for each patient. However, tumor growth is such a complicated process that it is difficult to stratify high-risk nodules from low-risk ones based on morphologic characteristics. On the other hand, recent deep learning studies using convolutional neural networks (CNNs) to predict the malignancy score of nodules, only provides clinicians with black-box predictions. To this end, we propose a unifie…
College of Physics and Information Engineering, Fuzhou University（福州大学物理与信息工程学院）；Thoracic Department, Fujian Medical University Union Hospital（福建医科大学附属协和医院胸外科）
Background and Objective:Computer-aided diagnosis (CAD) systems promote diagnosis effectiveness and alleviate pressure of radiologists. A CAD system for lung cancer diagnosis includes nodule candidate detection and nodule malignancy evaluation. Recently, deep learning-based pulmonary nodule detection has reached satisfactory performance ready for clinical application. However, deep learning-based nodule malignancy evaluation depends on heuristic inference from low-dose computed tomography volume to malignant probability, which lacks clinical cognition. Methods:In this paper, we propose a joint…
Institute for Systems and Computer Engineering, Technology and Science (INESC TEC)（系统与计算机工程、技术与科学研究所（INESC TEC））；Faculty of Engineering of the University of Porto (FEUP)（波尔图大学工程学院（FEUP））；University of Trás-os-Montes e Alto Douro (UTAD)（山后-上杜罗大学（UTAD））；Centro Hospitalar e Universitário de S. João（圣若昂大学医院中心）；Faculty of Medicine of the University of Porto (FMUP)（波尔图大学医学院（FMUP））
Lung cancer is the deadliest type of cancer worldwide and late detection is the major factor for the low survival rate of patients. Low dose computed tomography has been suggested as a potential screening tool but manual screening is costly, time-consuming and prone to variability. This has fueled the development of automatic methods for the detection, segmentation and characterisation of pulmonary nodules but its application to clinical routine is challenging. In this study, a new database for the development and testing of pulmonary nodule computer-aided strategies is presented which intends…
LMLCC-Net: A Semi-Supervised Deep Learning Model for Lung Nodule Malignancy Prediction from CT Scans using a Novel Hounsfield Unit-Based Intensity Filtering
mHealth Lab, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology（孟加拉国工程与技术大学生物医学工程系mHealth实验室）
Pulmonary lobe segmentation in computed tomography scans is essential for regional assessment of pulmonary diseases. Recent works based on convolution neural networks have achieved good performance for this task. However, they are still limited in capturing structured relationships due to the nature of convolution. The shape of the pulmonary lobes affect each other and their borders relate to the appearance of other structures, such as vessels, airways, and the pleural wall. We argue that such structural relationships play a critical role in the accurate delineation of pulmonary lobes when the…
Harbin Engineering University（哈尔滨工程大学）；Monash University（莫纳什大学）；Beijing Airdoc Technology Co., Ltd.（北京鹰瞳科技发展股份有限公司）；Chongqing Hospital of Traditional Chinese Medicine（重庆市中医院）；Chongqing Renji Hospital of Chinese Academy of Sciences（中国科学院重庆仁济医院）
Usually, lesions are not isolated but are associated with the surrounding tissues. For example, the growth of a tumour can depend on or infiltrate into the surrounding tissues. Due to the pathological nature of the lesions, it is challenging to distinguish their boundaries in medical imaging. However, these uncertain regions may contain diagnostic information. Therefore, the simple binarization of lesions by traditional binary segmentation can result in the loss of diagnostic information. In this work, we introduce the image matting into the 3D scenes and use the alpha matte, i.e., a soft mask…
High-risk Factor Prediction in Lung Cancer Using Thin CT Scans: An Attention-Enhanced Graph Convolutional Network Approach
Renmin University of China（中国人民大学）；Capital Medical University（首都医科大学）；Beijing Chao-Yang Hospital（北京朝阳医院）；Beijing Institute of Respiratory Medicine（北京呼吸疾病研究所）
Medical Artificial Intelligence for Early Detection of Lung Cancer: A Survey
College of Computer Science and Artificial Intelligence, Southwest Minzu University, Chengdu, 610225, China（计算机科学与人工智能学院，西南民族大学）；The Australian National University, Canberra ACT 2601, Australia（澳大利亚国立大学）；School of Computer Science and Technology, Beijing Jiaotong University, Beijing, China（计算机科学与技术学校，北京交通大学）；Hunan university of technology, Zhuzhou, 410072, China（湖南理工大学）；University of Adelaide, Adelaide, South Australia 5005, Australia（阿德莱德大学）；La Trobe University, Melbourne, Victoria 3086, Australia（拉筹伯大学）
The University of Sydney（悉尼大学）；Royal Prince Alfred Hospital（皇家阿尔弗雷德王子医院）
Accurate characterisation of visual attributes such as spiculation, lobulation, and calcification of lung nodules is critical in cancer management. The characterisation of these attributes is often subjective, which may lead to high inter- and intra-observer variability. Furthermore, lung nodules are often heterogeneous in the cross-sectional image slices of a 3D volume. Current state-of-the-art methods that score multiple attributes rely on deep learning-based multi-task learning (MTL) schemes. These methods, however, extract shared visual features across attributes and then examine each attr…
Data Science Institute（数据科学研究所）；University of Arizona（亚利桑那大学）
We propose a deep learning based method for classification of commonly occurring pathologies in chest X-ray images. The vast number of publicly available chest X-ray images provides the data necessary for successfully employing deep learning methodologies to reduce the misdiagnosis of thoracic diseases. We applied our method to the classification of two example pathologies, pulmonary nodules and cardiomegaly, and we compared the performance of our method to three existing methods. The results show an improvement in AUC for detection of nodules and cardiomegaly compared to the existing methods.
A Residual Multi-task Network for Joint Classification and Regression in Medical Imaging
School of Computer Science and Technology, University of Chinese Academy of Sciences（中国科学院大学计算机科学与技术学院）；College of Surveying and GeoInformatics, Tongji University（同济大学测绘与地理信息学院）；School of Computer Science, Shaanxi Normal University（陕西师范大学计算机学院）
