Feature Representation Analysis of Deep Convolutional Neural Network using Two-stage Feature Transfer -An Application for Diffuse Lung Disease Classification-
National Institute of Advanced Industrial Science and Technology(产业技术综合研究所);Yamaguchi University(山口大学);University of Electro-Communications(电气通信大学)
Preprint of the journal article to be published in IPSJ TOM-51. Notice for the use of this material The copyright of this material is retained by the Information Processing Society of Japan (IPSJ). This material is published on this web site with the agreement of the author (s) and the IPSJ
Transfer learning is a machine learning technique designed to improve generalization performance by using pre-trained parameters obtained from other learning tasks. For image recognition tasks, many previous studies have reported that, when transfer learning is applied to deep neural networks, performance improves, despite having limited training data. This paper proposes a two-stage feature transfer learning method focusing on the recognition of textural medical images. During the proposed method, a model is successively trained with massive amounts of natural images, some textural images, and the target images. We applied this method to the classification task of textural X-ray computed tomography images of diffuse lung diseases. In our experiment, the two-stage feature transfer achieves the best performance compared to a from-scratch learning and a conventional single-stage feature transfer. We also investigated the robustness of the target dataset, based on size. Two-stage feature transfer shows better robustness than the other two learning methods. Moreover, we analyzed the feature representations obtained from DLDs imagery inputs for each feature transfer models using a visualization method. We showed that the two-stage feature transfer obtains both edge and textural features of DLDs, which does not occur in conventional single-stage feature transfer models.
University Medical Center Hamburg-Eppendorf(汉堡-埃彭多夫大学医学中心);Hamburg University of Technology(汉堡工业大学);Forschungszentrum Medizintechnik Hamburg(汉堡医学技术研究中心);Philips Research(飞利浦研究院)
Chest radiography is the most common clinical examination type. To improve the quality of patient care and to reduce workload, methods for automatic pathology classification have been developed. In this contribution we investigate the usefulness of two advanced image pre-processing techniques, initially developed for image reading by radiologists, for the performance of Deep Learning methods. First, we use bone suppression, an algorithm to artificially remove the rib cage. Secondly, we employ an automatic lung field detection to crop the image to the lung area. Furthermore, we consider the com…
Imperial College London(伦敦帝国理工学院);Imperial College NHS Trust(帝国理工学院国民医疗服务信托)
Automated lobar segmentation allows regional evaluation of lung disease and is important for diagnosis and therapy planning. Advanced statistical workflows permitting such evaluation is a needed area within respiratory medicine; their adoption remains slow, with poor workflow accuracy. Diseased lung regions often produce high-density zones on CT images, limiting an algorithm's execution to specify damaged lobes due to oblique or lacking fissures. This impact motivated developing an improved machine learning method to segment lung lobes that utilises tracheobronchial tree information to enhance…
Multilabel Classification for Lung Disease Detection: Integrating Deep Learning and Natural Language Processing
Mechanical Engineering Staten Island Tech High School(Staten Island Tech High School机械工程系);Computer Science Monta Vista High School(Monta Vista High School计算机科学系);Computer Science Lambert High School(Lambert High School计算机科学系);Electrical Engineering Edison Academy Magnet School(Edison Academy Magnet School电气工程系)
Clinical Priors Guided Lung Disease Detection in 3D CT Scans
College of Computer Science and Artificial Intelligence, Shanghai Key Laboratory of Intelligent Information Processing, Fudan University(计算机科学与人工智能学院,上海智能信息处理重点实验室,复旦大学);University of Oxford(牛津大学);The Hong Kong University of Science and Technology(香港科技大学)
St. Joseph’s College of Engineering(圣约瑟夫工程学院);Techno India College of Technology(泰克诺印度技术学院);Shantou University(汕头大学);Cairo University(开罗大学);University of South Dakota(南达科他大学)
Pneumonia is one of the foremost lung diseases and untreated pneumonia will lead to serious threats for all age groups. The proposed work aims to extract and evaluate the Coronavirus disease (COVID-19) caused pneumonia infection in lung using CT scans. We propose an image-assisted system to extract COVID-19 infected sections from lung CT scans (coronal view). It includes following steps: (i) Threshold filter to extract the lung region by eliminating possible artifacts; (ii) Image enhancement using Harmony-Search-Optimization and Otsu thresholding; (iii) Image segmentation to extract infected r…
Rensselaer Polytechnic Institute(伦斯勒理工学院);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Niskayuna High School(尼斯卡尤纳高中)
Cancer patients have a higher risk of cardiovascular disease (CVD) mortality than the general population. Low dose computed tomography (LDCT) for lung cancer screening offers an opportunity for simultaneous CVD risk estimation in at-risk patients. Our deep learning CVD risk prediction model, trained with 30,286 LDCTs from the National Lung Cancer Screening Trial, achieved an area under the curve (AUC) of 0.871 on a separate test set of 2,085 subjects and identified patients with high CVD mortality risks (AUC of 0.768). We validated our model against ECG-gated cardiac CT based markers, includin…
School of Professional Studies(专业研究学院);Northwestern University(西北大学)
Artificial intelligence (AI) is disrupting the medical field as advances in modern technology allow common household computers to learn anatomical and pathological features that distinguish between healthy and disease with the accuracy of highly specialized, trained physicians. Computer vision AI applications use medical imaging, such as lung chest X-Rays (LCXRs), to facilitate diagnoses by providing second-opinions in addition to a physician's or radiologist's interpretation. Considering the advent of the current Coronavirus disease (COVID-19) pandemic, LCXRs may provide rapid insights to ind…
Yıldız Technical University(耶尔德兹技术大学);İstanbul University(伊斯坦布尔大学);Haseki Education Research Hospital(哈塞基教育研究医院)
In recent years, besides the medical treatment methods in medical field, Computer Aided Diagnosis (CAD) systems which can facilitate the decision making phase of the physician and can detect the disease at an early stage have started to be used frequently. The diagnosis of Idiopathic Pulmonary Fibrosis (IPF) disease by using CAD systems is very important in that it can be followed by doctors and radiologists. It has become possible to diagnose and follow up the disease with the help of CAD systems by the development of high resolution computed imaging scanners and increasing size of computatio…
Sberbank AI Laboratory(俄罗斯联邦储蓄银行人工智能实验室);New York University(纽约大学)
Analysis of chest CT scans can be used in detecting parts of lungs that are affected by infectious diseases such as COVID-19.Determining the volume of lungs affected by lesions is essential for formulating treatment recommendations and prioritizingpatients by severity of the disease. In this paper we adopted an approach based on using an ensemble of deep convolutionalneural networks for segmentation of slices of lung CT scans. Using our models we are able to segment the lesions, evaluatepatients dynamics, estimate relative volume of lungs affected by lesions and evaluate the lung damage stage.…
Automated diagnosis of lung diseases using vision transformer: a comparative study on chest x-ray classification
Centro de Investigación en Computación, Instituto Politécnico Nacional (CIC-IPN)(墨西哥国立理工学院计算机研究中心);Grand Asian University of Sialkot(锡亚尔科特大亚洲大学);The Islamia University of Bahawalpur(巴哈瓦尔布尔伊斯兰大学);Zhejiang Normal University(浙江师范大学);Leads University Lahore(拉合尔利兹大学)
University of Waterloo(滑铁卢大学);DarwinAI Corp.(DarwinAI公司);Stony Brook School of Medicine(石溪大学医学院);Montefiore Medical Center(蒙蒂菲奥里医疗中心);Albert Einstein College of Medicine(阿尔伯特·爱因斯坦医学院)
Background: A critical step in effective care and treatment planning for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the cause of the COVID-19 pandemic, is the assessment of the severity of disease progression. Chest x-rays (CXRs) are often used to assess SARS-CoV-2 severity, with two important assessment metrics being extent of lung involvement and degree of opacity. In this proof-of-concept study, we assess the feasibility of computer-aided scoring of CXRs of SARS-CoV-2 lung disease severity using a deep learning system. Materials and Methods: Data consisted of 396 CXRs fro…
Small Lesions-aware Bidirectional Multimodal Multiscale Fusion Network for Lung Disease Classification
Xidian University(西安电子科技大学);Hangzhou Dianzi University(杭州电子科技大学);Zhejiang College of Security Technology, School of Artificial Intelligence(浙江安全技术学院人工智能学院);Shenzhen Polytechnic University(深圳职业技术学院);Shenzhen University(深圳大学);Shenzhen Research Institute of Big Data(深圳大数据研究院)
Saratoga High School(萨拉托加高中);Stanford University(斯坦福大学)
Chest X-rays of coronavirus disease 2019 (COVID-19) patients are frequently obtained to determine the extent of lung disease and are a valuable source of data for creating artificial intelligence models. Most work to date assessing disease severity on chest imaging has focused on segmenting computed tomography (CT) images; however, given that CTs are performed much less frequently than chest X-rays for COVID-19 patients, automated lung lesion segmentation on chest X-rays could be clinically valuable. There currently exists a universal shortage of chest X-rays with ground truth COVID-19 lung le…
In recent years, the prevalence of several pulmonary diseases, especially the coronavirus disease 2019 (COVID-19) pandemic, has attracted worldwide attention. These diseases can be effectively diagnosed and treated with the help of lung imaging. With the development of deep learning technology and the emergence of many public medical image datasets, the diagnosis of lung diseases via medical imaging has been further improved. This article reviews pulmonary CT and X-ray image detection and classification in the last decade. It also provides an overview of the detection of lung nodules, pneumoni…
Classification based deep learning models for lung cancer and disease using medical images
Laboratory for Artificial Intelligence of Personalized Medicine, School of Artificial Intelligence, Guilin University of Electronic Technology(人工智能个性化医学实验室,人工智能学院,桂林电子科技大学);The Laboratory for Imagery, Vision and Artificial Intelligence, Ecole de Technologie Superieure(影像、视觉与人工智能实验室,蒙特利尔理工学院)
University of Pittsburgh(匹兹堡大学);Tangdu Hospital(唐都医院)
This study aims to automatically diagnose thoracic diseases depicted on the chest x-ray (CXR) images using deep convolutional neural networks. The existing methods generally used the entire CXR images for training purposes, but this strategy may suffer from two drawbacks. First, potential misalignment or the existence of irrelevant objects in the entire CXR images may cause unnecessary noise and thus limit the network performance. Second, the relatively low image resolution caused by the resizing operation, which is a common preprocessing procedure for training neural networks, may lead to the…
Bharti School of Telecommunications Technology & Management, Indian Institute of Technology Delhi(印度理工学院德里分校巴蒂电信技术与管理学院);Teleradiology Solutions(远程放射学解决方案公司);CSIR-Institute of Genomics and Integrative Biology(CSIR基因组学与整合生物学研究所);Christian Medical College, Vellore(韦洛尔基督教医学院)
A chest radiograph, commonly called chest x-ray (CxR), plays a vital role in the diagnosis of various lung diseases, such as lung cancer, tuberculosis, pneumonia, and many more. Automated segmentation of the lungs is an important step to design a computer-aided diagnostic tool for examination of a CxR. Precise lung segmentation is considered extremely challenging because of variance in the shape of the lung caused by health issues, age, and gender. The proposed work investigates the use of an efficient deep convolutional neural network for accurate segmentation of lungs from CxR. We attempt an…
National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute"(乌克兰国立技术大学“伊戈尔·西科斯基基辅理工学院”);Huizhou University(惠州学院)
The recent progress of computing, machine learning, and especially deep learning, for image recognition brings a meaningful effect for automatic detection of various diseases from chest X-ray images (CXRs). Here efficiency of lung segmentation and bone shadow exclusion techniques is demonstrated for analysis of 2D CXRs by deep learning approach to help radiologists identify suspicious lesions and nodules in lung cancer patients. Training and validation was performed on the original JSRT dataset (dataset #01), BSE-JSRT dataset, i.e. the same JSRT dataset, but without clavicle and rib shadows (d…
Explainable Cross-Disease Reasoning for Cardiovascular Risk Assessment from Low-Dose Computed Tomography
Department of Computer Science, Emory University(埃默里大学计算机科学系);Department of Computer Science, Johns Hopkins University(约翰霍普金斯大学计算机科学系);Department of Radiation Oncology(放射肿瘤学部);Winship Cancer Institute, Emory University(埃默里大学Winship癌症研究所)
University of Technology Sydney(悉尼科技大学);Mehr General Hospital(Mehr综合医院);Charles Sturt University(查尔斯特大学)
The COVID-19 pandemic has inspired unprecedented data collection and computer vision modelling efforts worldwide, focusing on diagnosis and stratification of COVID-19 from medical images. Despite this large-scale research effort, these models have found limited practical application due in part to unproven generalization of these models beyond their source study. This study investigates the generalizability of key published models using the publicly available COVID-19 Computed Tomography data through cross dataset validation. We then assess the predictive ability of these models for COVID-19 s…
As of June 2021, the World Health Organization (WHO) has reported 171.7 million confirmed cases including 3,698,621 deaths from COVID-19. Detecting COVID-19 and other lung diseases from Chest X-Ray (CXR) images can be very effective for emergency diagnosis and treatment as CXR is fast and cheap. The objective of this study is to develop a system capable of detecting COVID-19 along with 14 other lung diseases from CXRs in a fair and unbiased manner. The proposed system consists of a CXR image selection technique and a deep learning based model to classify 15 diseases including COVID-19. The pro…
AI Research Group, Institute of Mathematics(人工智能研究组,数学研究所);Eötvös Loránd University(罗兰大学)
Chest X-ray is the most common test among medical imaging modalities. It is applied for detection and differentiation of, among others, lung cancer, tuberculosis, and pneumonia, the last with importance due to the COVID-19 disease. Integrating computer-aided detection methods into the radiologist diagnostic pipeline, greatly reduces the doctors' workload, increasing reliability and quantitative analysis. Here we present a novel deep learning approach for lung segmentation, a basic, but arduous task in the diagnostic pipeline. Our method uses state-of-the-art fully convolutional neural networks…
Artificial Intelligence-assisted Pixel-level Lung (APL) Scoring for Fast and Accurate Quantification in Ultra-short Echo-time MRI
Australian E-health Research Centre, CSIRO(澳大利亚电子健康研究中心,联邦科学与工业研究组织);The University of Queensland(昆士兰大学);Queensland Children's Hospital(昆士兰儿童医院);Siemens Healthcare Pty Ltd(西门子医疗有限公司);Siemens Healthineers AG(西门子医疗股份公司)
Cancer is the uncontrollable cell division of abnormal cells inside the human body, which can spread to other body organs. It is one of the non-communicable diseases (NCDs) and NCDs accounts for 71% of total deaths worldwide whereas lung cancer is the second most diagnosed cancer after female breast cancer. Cancer survival rate of lung cancer is only 19%. There are various methods for the diagnosis of lung cancer, such as X-ray, CT scan, PET-CT scan, bronchoscopy and biopsy. However, to know the subtype of lung cancer based on the tissue type H and E staining is widely used, where the staining…
REN: Anatomically-Informed Mixture-of-Experts for Interstitial Lung Disease Diagnosis
Department of Computer Science, Northwestern University McCormick School of Engineering and Applied Science(西北大学麦考密克工程与应用科学学院计算机科学系);Division of Pulmonary and Critical Care Medicine, Northwestern University Feinberg School of Medicine(西北大学范伯格医学院肺与危重症医学科);Division of Rheumatology, Northwestern University Feinberg School of Medicine(西北大学范伯格医学院风湿病科);Simpson Querrey Lung Institute for Translational Science, Northwestern University Feinberg School of Medicine(西北大学范伯格医学院辛普森·奎雷转化科学肺研究所);Department of Electrical and Computer Engineering, Northwestern University McCormick School of Engineering and Applied Science(西北大学麦考密克工程与应用科学学院电气与计算机工程系);Machine & Hybrid Intelligence Lab, Department of Radiology, Northwestern University Feinberg School of Medicine(西北大学范伯格医学院放射科机器与混合智能实验室)
Rensselaer Polytechnic Institute(伦斯勒理工学院);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院)
Although radiographs are the most frequently used worldwide due to their cost-effectiveness and widespread accessibility, the structural superposition along the x-ray paths often renders suspicious or concerning lung nodules difficult to detect. In this study, we apply "X-ray dissectography" to dissect lungs digitally from a few radiographic projections, suppress the interference of irrelevant structures, and improve lung nodule detectability. For this purpose, a collaborative detection network is designed to localize lung nodules in 2D dissected projections and 3D physical space. Our experime…
COVID-19, also known as Novel Coronavirus Disease, is a highly contagious disease that first surfaced in China in late 2019. SARS-CoV-2 is a coronavirus that belongs to the vast family of coronaviruses that causes this disease. The sickness originally appeared in Wuhan, China in December 2019 and quickly spread to over 213 nations, becoming a global pandemic. Fever, dry cough, and tiredness are the most typical COVID-19 symptoms. Aches, pains, and difficulty breathing are some of the other symptoms that patients may face. The majority of these symptoms are indicators of respiratory infections …
Total lung volume is an important quantitative biomarker and is used for the assessment of restrictive lung diseases. In this study, we investigate the performance of several deep-learning approaches for automated measurement of total lung volume from chest radiographs. 7621 posteroanterior and lateral view chest radiographs (CXR) were collected from patients with chest CT available. Similarly, 928 CXR studies were chosen from patients with pulmonary function test (PFT) results. The reference total lung volume was calculated from lung segmentation on CT or PFT data, respectively. This dataset …
University of Copenhagen(哥本哈根大学);Cerebriu AS(Cerebriu公司);Technical University of Denmark(丹麦技术大学)
Pulmonary opacification is the inflammation in the lungs caused by many respiratory ailments, including the novel corona virus disease 2019 (COVID-19). Chest X-rays (CXRs) with such opacifications render regions of lungs imperceptible, making it difficult to perform automated image analysis on them. In this work, we focus on segmenting lungs from such abnormal CXRs as part of a pipeline aimed at automated risk scoring of COVID-19 from CXRs. We treat the high opacity regions as missing data and present a modified CNN-based image segmentation network that utilizes a deep generative model for dat…
Suppression of thoracic bone shadows on chest X-rays (CXRs) has been indicated to improve the diagnosis of pulmonary disease. Previous approaches can be categorized as unsupervised physical and supervised deep learning models. Nevertheless, with physical models able to preserve morphological details but at the cost of extremely long processing time, existing DL methods face challenges of gathering sufficient/qualitative ground truth (GT) for robust training, thus leading to failure in maintaining clinically acceptable false positive rates. We hereby propose a generalizable yet efficient workfl…
Inception Institute of Artificial Intelligence(Inception人工智能研究院)
In supervised learning for medical image analysis, sample selection methodologies are fundamental to attain optimum system performance promptly and with minimal expert interactions (e.g. label querying in an active learning setup). In this paper we propose a novel sample selection methodology based on deep features leveraging information contained in interpretability saliency maps. In the absence of ground truth labels for informative samples, we use a novel self supervised learning based approach for training a classifier that learns to identify the most informative sample in a given batch of…
Birla Institute of Technology and Science, Pilani(博拉理工学院皮拉尼校区);Hiroshima University(广岛大学);Keimyung University Dongsan Medical Center(启明大学东山医疗中心)
Lung cancer is one of the most deadly diseases in the world. Detecting such tumors at an early stage can be a tedious task. Existing deep learning architecture for lung nodule identification used complex architecture with large number of parameters. This study developed a cascaded architecture which can accurately segment and classify the benign or malignant lung nodules on computed tomography (CT) images. The main contribution of this study is to introduce a segmentation network where the first stage trained on a public data set can help to recognize the images which included a nodule from an…
KU Leuven(鲁汶大学);UZ Leuven(鲁汶大学医院);Vrije Universiteit Brussel (VUB)(布鲁塞尔自由大学);imec
Recent research on COVID-19 suggests that CT imaging provides useful information to assess disease progression and assist diagnosis, in addition to help understanding the disease. There is an increasing number of studies that propose to use deep learning to provide fast and accurate quantification of COVID-19 using chest CT scans. The main tasks of interest are the automatic segmentation of lung and lung lesions in chest CT scans of confirmed or suspected COVID-19 patients. In this study, we compare twelve deep learning algorithms using a multi-center dataset, including both open-source and in…
Isfahan University of Technology(伊斯法罕理工大学);Seattle University(西雅图大学);McMaster University(麦克马斯特大学)
The new coronavirus infection has shocked the world since early 2020 with its aggressive outbreak. Rapid detection of the disease saves lives, and relying on medical imaging (Computed Tomography and X-ray) to detect infected lungs has shown to be effective. Deep learning and convolutional neural networks have been used for image analysis in this context. However, accurate identification of infected regions has proven challenging for two main reasons. Firstly, the characteristics of infected areas differ in different images. Secondly, insufficient training data makes it challenging to train var…
Validated respiratory drug deposition predictions from 2D and 3D medical images with statistical shape models and convolutional neural networks
Heriot-Watt University(赫瑞瓦特大学);Royal Hospital for Children and Young People, NHS Lothian(NHS洛锡安区儿童与青少年皇家医院);University Hospital Southampton NHS Foundation Trust(南安普顿大学医院NHS基金会信托);Brunel University(布鲁内尔大学);University of Edinburgh(爱丁堡大学)
Expert Uncertainty and Severity Aware Chest X-Ray Classification by Multi-Relationship Graph Learning
University of Texas at Arlington(德克萨斯大学阿灵顿分校);RIKEN(理化学研究所);University of Tokyo(东京大学);National Institute of Health Clinical Center(美国国立卫生研究院临床中心);National Cancer Center Research Institute(国立癌症研究中心研究所)
Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology(孟加拉国工程技术大学信息与通信技术研究所)
Lung disease is common throughout the world. These include chronic obstructive pulmonary disease, pneumonia, asthma, tuberculosis, fibrosis, etc. Timely diagnosis of lung disease is essential. Many image processing and machine learning models have been developed for this purpose. Different forms of existing deep learning techniques including convolutional neural network (CNN), vanilla neural network, visual geometry group based neural network (VGG), and capsule network are applied for lung disease prediction.The basic CNN has poor performance for rotated, tilted, or other abnormal image orient…
University of Sheffield(谢菲尔德大学);Sheffield Teaching Hospitals NHS Foundation Trust(谢菲尔德教学医院NHS基金会信托);INSIGNEO, Institute for In Silico Medicine, University of Sheffield(谢菲尔德大学INSIGNEO计算医学研究所);NIHR Sheffield Biomedical Research Centre, University of Sheffield(谢菲尔德大学NIHR谢菲尔德生物医学研究中心)
Purpose: Lung disease assessment in precapillary pulmonary hypertension (PH) is essential for appropriate patient management. This study aims to develop an artificial intelligence (AI) deep learning model for lung texture classification in CT Pulmonary Angiography (CTPA), and evaluate its correlation with clinical assessment methods. Materials and Methods: In this retrospective study with external validation, 122 patients with pre-capillary PH were used to train (n=83), validate (n=17) and test (n=10 internal test, n=12 external test) a patch based DenseNet-121 classification model. "Normal", …
Deep Learning for Lung Disease Classification Using Transfer Learning and a Customized CNN Architecture with Attention
Ira A. Fulton Schools of Engineering(艾拉·A·富尔顿工程学院);Arizona State University(亚利桑那州立大学);University of Illinois at Chicago(芝加哥大学伊利诺伊分校);W. P. Carey School of Business(W. P. 凯瑞商学院)
Evaluating LeNet Algorithms in Classification Lung Cancer from Iraq-Oncology Teaching Hospital/National Center for Cancer Diseases
Faculty of Electrical and Computer Engineering, Islamic Azad University(伊斯兰阿扎德大学电气与计算机工程学院);Young Researchers and Elite Club, Ardabil Branch, Islamic Azad University(伊斯兰阿扎德大学阿尔达比尔分校青年研究者与精英俱乐部);Iraq-Oncology Teaching Hospital/National Center for Cancer Diseases(伊拉克肿瘤学教学医院/国家癌症疾病中心)
University of Liverpool(利物浦大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Science and Technologies Facilities Council(科学与技术设施委员会)
Interstitial lung diseases are a large group of heterogeneous diseases characterized by different degrees of alveolitis and pulmonary fibrosis. Accurately diagnosing these diseases has significant guiding value for formulating treatment plans. Although previous work has produced impressive results in classifying interstitial lung diseases, there is still room for improving the accuracy of these techniques, mainly to enhance automated decision-making. In order to improve the classification precision, our study proposes a convolutional neural networks-based framework with auxiliary information. …