In this work, we estimate the severity of pneumonia in COVID-19 patients and conduct a longitudinal study of disease progression. To achieve this goal, we developed a deep learning model for simultaneous detection and segmentation of pneumonia in chest Xray (CXR) images and generalized to COVID-19 pneumonia. The segmentations were utilized to calculate a "Pneumonia Ratio" which indicates the disease severity. The measurement of disease severity enables to build a disease extent profile over time for hospitalized patients. To validate the model relevance to the patient monitoring task, we developed a validation strategy which involves a synthesis of Digital Reconstructed Radiographs (DRRs - synthetic Xray) from serial CT scans; we then compared the disease progression profiles that were generated from the DRRs to those that were generated from CT volumes.
University of Waterloo（滑铁卢大学）；DarwinAI Corp.（DarwinAI公司）；Niagara Health（尼亚加拉医疗）；McMaster University（麦克马斯特大学）；Thunder Bay Regional Health Sciences Centre（桑德贝地区健康科学中心）；Northern Ontario School of Medicine（北部安大略医学院）
The world is still struggling in controlling and containing the spread of the COVID-19 pandemic caused by the SARS-CoV-2 virus. The medical conditions associated with SARS-CoV-2 infections have resulted in a surge in the number of patients at clinics and hospitals, leading to a significantly increased strain on healthcare resources. As such, an important part of managing and handling patients with SARS-CoV-2 infections within the clinical workflow is severity assessment, which is often conducted with the use of chest x-ray (CXR) images. In this work, we introduce COVID-Net CXR-S, a convolution…
University of Waterloo（滑铁卢大学）；DarwinAI Corp.（DarwinAI公司）；Stony Brook School of Medicine（石溪大学医学院）；Montefiore Medical Center（蒙蒂菲奥里医疗中心）；Albert Einstein College of Medicine（阿尔伯特·爱因斯坦医学院）
Background: A critical step in effective care and treatment planning for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), the cause of the COVID-19 pandemic, is the assessment of the severity of disease progression. Chest x-rays (CXRs) are often used to assess SARS-CoV-2 severity, with two important assessment metrics being extent of lung involvement and degree of opacity. In this proof-of-concept study, we assess the feasibility of computer-aided scoring of CXRs of SARS-CoV-2 lung disease severity using a deep learning system. Materials and Methods: Data consisted of 396 CXRs fro…
Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）；Asan Medical Center, University of Ulsan College of Medicine（蔚山大学医学院峨山医学中心）；College of Medicine, Yeungnam University（岭南大学医学院）；School of Medicine, Kyungpook National University（庆北国立大学医学院）
Developing a robust algorithm to diagnose and quantify the severity of COVID-19 using Chest X-ray (CXR) requires a large number of well-curated COVID-19 datasets, which is difficult to collect under the global COVID-19 pandemic. On the other hand, CXR data with other findings are abundant. This situation is ideally suited for the Vision Transformer (ViT) architecture, where a lot of unlabeled data can be used through structural modeling by the self-attention mechanism. However, the use of existing ViT is not optimal, since feature embedding through direct patch flattening or ResNet backbone in…
Expert Uncertainty and Severity Aware Chest X-Ray Classification by Multi-Relationship Graph Learning
University of Texas at Arlington（德克萨斯大学阿灵顿分校）；RIKEN（理化学研究所）；University of Tokyo（东京大学）；National Institute of Health Clinical Center（美国国立卫生研究院临床中心）；National Cancer Center Research Institute（国立癌症研究中心研究所）
Coronavirus disease (COVID-19) is a contagious infection caused by severe acute respiratory syndrome coronavirus-2 (SARS-COV-2) and it has infected and killed millions of people across the globe. In the absence of specific drugs or vaccines for the treatment of COVID-19 and the limitation of prevailing diagnostic techniques, there is a requirement for some alternate automatic screening systems that can be used by the physicians to quickly identify and isolate the infected patients. A chest X-ray (CXR) image can be used as an alternative modality to detect and diagnose the COVID-19. In this stu…
Qatar University（卡塔尔大学）；Bangladesh University of Engineering and Technology（孟加拉国工程技术大学）；Reem Medical Center（Reem医疗中心）；Hamad General Hospital（哈马德综合医院）；Weill Cornell Medicine - Qatar（威尔康奈尔医学院卡塔尔分校）
Coronavirus disease 2019 (COVID-19) has been the main agenda of the whole world, since it came into sight in December 2019 as it has significantly affected the world economy and healthcare system. Given the effects of COVID-19 on pulmonary tissues, chest radiographic imaging has become a necessity for screening and monitoring the disease. Numerous studies have proposed Deep Learning approaches for the automatic diagnosis of COVID-19. Although these methods achieved astonishing performance in detection, they have used limited chest X-ray (CXR) repositories for evaluation, usually with a few hun…
Vision Transformer-based Model for Severity Quantification of Lung Pneumonia Using Chest X-ray Images
University of the Basque Country（巴斯克大学）；IKERBASQUE；Ho Chi Minh City Open University（胡志明市开放大学）；University of Strasbourg（斯特拉斯堡大学）；INSERM（法国国家健康与医学研究院）；Université de Haute-Alsace（上阿尔萨斯大学）
本文提出 ViTReg-IP，一种由 ViT 与回归头构成的轻量模型，用于根据胸部 X 光量化 COVID-19 等肺病严重程度，并在多来源数据集上验证其低成本、高性能与泛化性。
National Institute of Technology Karnataka（卡纳塔克邦国立理工学院）；Kasturba Medical College and Hospital, Manipal（马尼帕尔卡斯图巴医学院及医院）；Manipal Academy of Higher Education（马尼帕尔高等教育学院）；J.S.S. Medical College, Mysore（迈索尔J.S.S.医学院）；JSS Academy of Higher Education and Research（JSS高等教育与研究学院）
The world is going through a challenging phase due to the disastrous effect caused by the COVID-19 pandemic on the healthcare system and the economy. The rate of spreading, post-COVID-19 symptoms, and the occurrence of new strands of COVID-19 have put the healthcare systems in disruption across the globe. Due to this, the task of accurately screening COVID-19 cases has become of utmost priority. Since the virus infects the respiratory system, Chest X-Ray is an imaging modality that is adopted extensively for the initial screening. We have performed a comprehensive study that uses CXR images to…
Charles Sturt University（查尔斯特大学）；University of Technology Sydney（悉尼科技大学）；Wollongong Hospital（伍伦贡医院）
The application of computer vision for COVID-19 diagnosis is complex and challenging, given the risks associated with patient misclassifications. Arguably, the primary value of medical imaging for COVID-19 lies rather on patient prognosis. Radiological images can guide physicians assessing the severity of the disease, and a series of images from the same patient at different stages can help to gauge disease progression. Hence, a simple method based on lung-pathology interpretable features for scoring disease severity from Chest X-rays is proposed here. As the primary contribution, this method …
Qatar University（卡塔尔大学）；North South University（北南大学）；University of South Carolina（南卡罗来纳大学）；Hamad General Hospital（哈马德综合医院）；AFG College with the University of Aberdeen（阿伯丁大学AFG学院）
Fast and accurate detection of the disease can significantly help in reducing the strain on the healthcare facility of any country to reduce the mortality during any pandemic. The goal of this work is to create a multimodal system using a novel machine learning framework that uses both Chest X-ray (CXR) images and clinical data to predict severity in COVID-19 patients. In addition, the study presents a nomogram-based scoring technique for predicting the likelihood of death in high-risk patients. This study uses 25 biomarkers and CXR images in predicting the risk in 930 COVID-19 patients admitt…
In this work we design an end-to-end deep learning architecture for predicting, on Chest X-rays images (CXR), a multi-regional score conveying the degree of lung compromise in COVID-19 patients. Such semi-quantitative scoring system, namely Brixia~score, is applied in serial monitoring of such patients, showing significant prognostic value, in one of the hospitals that experienced one of the highest pandemic peaks in Italy. To solve such a challenging visual task, we adopt a weakly supervised learning strategy structured to handle different tasks (segmentation, spatial alignment, and score est…
COVID-19 Infection Map Generation and Detection from Chest X-Ray Images
Tampere University（坦佩雷大学）；Qatar University（卡塔尔大学）；Reem Medical Center（里姆医疗中心）；Hamad Medical Corporation Hospital（哈马德医疗公司医院）；Weill Cornell Medicine - Qatar（威尔康奈尔医学院卡塔尔分校）
Stony Brook University（石溪大学）；Newark Beth Israel Medical Center（纽瓦克贝丝以色列医疗中心）；University Hospitals Cleveland Medical Center（大学医院克利夫兰医疗中心）
We predict mechanical ventilation requirement and mortality using computational modeling of chest radiographs (CXRs) for coronavirus disease 2019 (COVID-19) patients. This two-center, retrospective study analyzed 530 deidentified CXRs from 515 COVID-19 patients treated at Stony Brook University Hospital and Newark Beth Israel Medical Center between March and August 2020. DL and machine learning classifiers to predict mechanical ventilation requirement and mortality were trained and evaluated using patient CXRs. A novel radiomic embedding framework was also explored for outcome prediction. All …
Andalusian Research Institute in Data Science and Computational Intelligence（安达卢西亚数据科学与计算智能研究所）；University of Granada（格拉纳达大学）；University of Vigo（维戈大学）；University of Alicante（阿利坎特大学）
Currently, Coronavirus disease (COVID-19), one of the most infectious diseases in the 21st century, is diagnosed using RT-PCR testing, CT scans and/or Chest X-Ray (CXR) images. CT (Computed Tomography) scanners and RT-PCR testing are not available in most medical centers and hence in many cases CXR images become the most time/cost effective tool for assisting clinicians in making decisions. Deep learning neural networks have a great potential for building COVID-19 triage systems and detecting COVID-19 patients, especially patients with low severity. Unfortunately, current databases do not allo…
University of Copenhagen（哥本哈根大学）；Cerebriu AS（Cerebriu公司）；Technical University of Denmark（丹麦技术大学）
Pulmonary opacification is the inflammation in the lungs caused by many respiratory ailments, including the novel corona virus disease 2019 (COVID-19). Chest X-rays (CXRs) with such opacifications render regions of lungs imperceptible, making it difficult to perform automated image analysis on them. In this work, we focus on segmenting lungs from such abnormal CXRs as part of a pipeline aimed at automated risk scoring of COVID-19 from CXRs. We treat the high opacity regions as missing data and present a modified CNN-based image segmentation network that utilizes a deep generative model for dat…
Stony Brook University（石溪大学）；Newark Beth Israel Medical Center（纽瓦克贝丝以色列医疗中心）
COVID-19 image analysis has mostly focused on diagnostic tasks using single timepoint scans acquired upon disease presentation or admission. We present a deep learning-based approach to predict lung infiltrate progression from serial chest radiographs (CXRs) of COVID-19 patients. Our method first utilizes convolutional neural networks (CNNs) for feature extraction from patches within the concerned lung zone, and also from neighboring and remote boundary regions. The framework further incorporates a multi-scale Gated Recurrent Unit (GRU) with a correlation module for effective predictions. The …
Deep learning-based lung segmentation and automatic regional template in chest X-ray images for pediatric tuberculosis
Universidad Politécnica de Madrid（马德里理工大学）；CIBER-BBN（生物工程、生物材料与纳米医学网络研究中心）；Children’s National Hospital（国家儿童医院）；George Washington University School of Medicine（乔治华盛顿大学医学院）；ISGlobal（巴塞罗那全球健康研究所）；Hospital Clínic（巴塞罗那临床医院）；Universitat de Barcelona（巴塞罗那大学）；Stellenbosch University（斯泰伦博斯大学）
Indian Institute of Technology Madras（印度理工学院马德拉斯分校）
Computed Tomography (CT) scans provide a detailed image of the lungs, allowing clinicians to observe the extent of damage caused by COVID-19. The CT severity score (CTSS) based scoring method is used to identify the extent of lung involvement observed on a CT scan. This paper presents a domain knowledge-based pipeline for extracting regions of infection in COVID-19 patients using a combination of image-processing algorithms and a pre-trained UNET model. The severity of the infection is then classified into different categories using an ensemble of three machine-learning models: Extreme Gradien…
Chulalongkorn University（朱拉隆功大学）；Thai Health AI Foundation（泰国健康人工智能基金会）；Johns Hopkins Bloomberg School of Public Health（约翰斯·霍普金斯大学布隆伯格公共卫生学院）
Machine learning has been an emerging tool for various aspects of infectious diseases including tuberculosis surveillance and detection. However, WHO provided no recommendations on using computer-aided tuberculosis detection software because of the small number of studies, methodological limitations, and limited generalizability of the findings. To quantify the generalizability of the machine-learning model, we developed a Deep Convolutional Neural Network (DCNN) model using a TB-specific CXR dataset of one population (National Library of Medicine Shenzhen No.3 Hospital) and tested it with non…
Deep Learning Models to Automate the Scoring of Hand Radiographs for Rheumatoid Arthritis
Nuffield Department of Population Health, University of Oxford（牛津大学纳菲尔德人口健康系）；Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford（牛津大学纳菲尔德骨科、风湿病学与肌肉骨骼科学系）
Korea Advanced Institute of Science and Technology（韩国科学技术院）；Asan Medical Center（峨山医院）；University of Ulsan College of Medicine（蔚山大学医学院）；College of Medicine, Chungnam National Univerity（忠南国立大学医学院）；College of Medicine, Yeungnam University（岭南大学医学院）；School of Medicine, Kyungpook National University（庆北国立大学医学院）
Under the global pandemic of COVID-19, building an automated framework that quantifies the severity of COVID-19 and localizes the relevant lesion on chest X-ray images has become increasingly important. Although pixel-level lesion severity labels, e.g. lesion segmentation, can be the most excellent target to build a robust model, collecting enough data with such labels is difficult due to time and labor-intensive annotation tasks. Instead, array-based severity labeling that assigns integer scores on six subdivisions of lungs can be an alternative choice enabling the quick labeling. Several gro…
University of California, San Francisco（加州大学旧金山分校）
Purpose: To evaluate the diagnostic utility of two convolutional neural networks (CNNs) for severity staging of anterior cruciate ligament (ACL) injuries. Materials and Methods: This retrospective analysis was conducted on 1243 knee MR images (1008 intact, 18 partially torn, 77 fully torn, and 140 reconstructed ACLs) from 224 patients (age 47 +/- 14 years, 54% women) acquired between 2011 and 2014. The radiologists used a modified scoring metric. To classify ACL injuries with deep learning, two types of CNNs were used, one with three-dimensional (3D) and the other with two-dimensional (2D) con…
Carnegie Mellon University（卡内基梅隆大学）；Louisiana State University（路易斯安那州立大学）；Cosmeticsurg.net, LLC（Cosmeticsurg.net有限责任公司）
With the onset of the COVID-19 pandemic, ultrasound has emerged as an effective tool for bedside monitoring of patients. Due to this, a large amount of lung ultrasound scans have been made available which can be used for AI based diagnosis and analysis. Several AI-based patient severity scoring models have been proposed that rely on scoring the appearance of the ultrasound scans. AI models are trained using ultrasound-appearance severity scores that are manually labeled based on standardized visual features. We address the challenge of labeling every ultrasound frame in the video clips. Our co…
Machine-Learning Based Detection of Coronary Artery Calcification Using Synthetic Chest X-Rays
School of Computer Science and Engineering, University of New South Wales（新南威尔士大学计算机科学与工程学院）；School of Mechanical and Manufacturing Engineering, University of New South Wales（新南威尔士大学机械与制造工程学院）；Independent Researcher, Sydney, Australia（独立研究者）
Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）；Harvard Medical School（哈佛医学院）；Massachusetts Institute of Technology（麻省理工学院）；Philips Research（飞利浦研究院）
Purpose: To develop a machine learning model to classify the severity grades of pulmonary edema on chest radiographs. Materials and Methods: In this retrospective study, 369,071 chest radiographs and associated radiology reports from 64,581 (mean age, 51.71; 54.51% women) patients from the MIMIC-CXR chest radiograph dataset were included. This dataset was split into patients with and without congestive heart failure (CHF). Pulmonary edema severity labels from the associated radiology reports were extracted from patients with CHF as four different ordinal levels: 0, no edema; 1, vascular conges…
University of Technology Sydney（悉尼科技大学）；Mehr General Hospital（Mehr综合医院）；Charles Sturt University（查尔斯特大学）
The COVID-19 pandemic has inspired unprecedented data collection and computer vision modelling efforts worldwide, focusing on diagnosis and stratification of COVID-19 from medical images. Despite this large-scale research effort, these models have found limited practical application due in part to unproven generalization of these models beyond their source study. This study investigates the generalizability of key published models using the publicly available COVID-19 Computed Tomography data through cross dataset validation. We then assess the predictive ability of these models for COVID-19 s…
Christian Medical College Ludhiana（卢迪亚纳基督教医学院）；Pacific Neuroscience Institute（太平洋神经科学研究所）
A stroke occurs when an artery in the brain ruptures and bleeds or when the blood supply to the brain is cut off. Blood and oxygen cannot reach the brain's tissues due to the rupture or obstruction resulting in tissue death. The Middle cerebral artery (MCA) is the largest cerebral artery and the most commonly damaged vessel in stroke. The quick onset of a focused neurological deficit caused by interruption of blood flow in the territory supplied by the MCA is known as an MCA stroke. Alberta stroke programme early CT score (ASPECTS) is used to estimate the extent of early ischemic changes in pa…
Massachusetts Institute of Technology（麻省理工学院）；Philips Research North America（飞利浦北美研究院）；Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）；Harvard Medical School（哈佛医学院）；Brigham and Women’s Hospital（布莱根妇女医院）
We propose and demonstrate machine learning algorithms to assess the severity of pulmonary edema in chest x-ray images of congestive heart failure patients. Accurate assessment of pulmonary edema in heart failure is critical when making treatment and disposition decisions. Our work is grounded in a large-scale clinical dataset of over 300,000 x-ray images with associated radiology reports. While edema severity labels can be extracted unambiguously from a small fraction of the radiology reports, accurate annotation is challenging in most cases. To take advantage of the unlabeled images, we deve…
Enhancing chest X-ray datasets with privacy-preserving large language models and multi-type annotations: a data-driven approach for improved classification
Imaging Biomarkers and Computer-Aided Diagnosis Laboratory, Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center（影像生物标志物与计算机辅助诊断实验室，放射学与成像科学系，国家卫生研究院临床中心）
TMF-RSE: Tri-Modal Fusion with Regional Semantics and Evidential Uncertainty for Lung Severity Scoring
Institute of Applied Sciences and Intelligent Systems (ISASI), CNR（应用科学与智能系统研究所（ISASI），CNR）；Department of Computer Science and Artificial Intelligence, University of the Basque Country (UPV/EHU)（巴斯克国家大学计算机科学与人工智能系）；University of Salento（萨莱nton大学）
Multi-Dataset Multi-Task Learning for COVID-19 Prognosis
Unit of Computer Systems \& Bioinformatics, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy College of Computer Science；Software Engineering, Shenzhen University, Shenzhen, China Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China
University College London（伦敦大学学院）；Frimley Health NHS Foundation Trust（弗林利健康NHS基金会信托）；Royal Berkshire NHS Foundation Trust（皇家伯克希尔NHS基金会信托）；Hospital de La Santa Creu I Sant Pau（圣十字圣保罗医院）；West Suffolk NHS Foundation Trust（西萨福克NHS基金会信托）；University of Cambridge（剑桥大学）；Great Ormond Street Children's Hospital NHS Foundation Trust（大奥蒙德街儿童医院NHS基金会信托）；University of Pavia（帕维亚大学）
Artificial intelligence-based analysis of lung ultrasound imaging has been demonstrated as an effective technique for rapid diagnostic decision support throughout the COVID-19 pandemic. However, such techniques can require days- or weeks-long training processes and hyper-parameter tuning to develop intelligent deep learning image analysis models. This work focuses on leveraging 'off-the-shelf' pre-trained models as deep feature extractors for scoring disease severity with minimal training time. We propose using pre-trained initializations of existing methods ahead of simple and compact neural …
School of Computing, University of Utah（犹他大学计算机学院）；NVIDIA Corporation（英伟达公司）；Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center（美国国立卫生研究院临床中心放射科与影像科学部）；National Institutes of Health Clinical Center（美国国立卫生研究院临床中心）；National Institutes of Health（美国国立卫生研究院）
Localization and characterization of diseases like pneumonia are primary steps in a clinical pipeline, facilitating detailed clinical diagnosis and subsequent treatment planning. Additionally, such location annotated datasets can provide a pathway for deep learning models to be used for downstream tasks. However, acquiring quality annotations is expensive on human resources and usually requires domain expertise. On the other hand, medical reports contain a plethora of information both about pneumonia characteristics and its location. In this paper, we propose a novel weakly-supervised attentio…
Early detection of COVID-19 is key in containing the pandemic. Disease detection and evaluation based on imaging is fast and cheap and therefore plays an important role in COVID-19 handling. COVID-19 is easier to detect in chest CT, however, it is expensive, non-portable, and difficult to disinfect, making it unfit as a point-of-care (POC) modality. On the other hand, chest X-ray (CXR) and lung ultrasound (LUS) are widely used, yet, COVID-19 findings in these modalities are not always very clear. Here we train deep neural networks to significantly enhance the capability to detect, grade and mo…
Chronological Contrastive Learning: Few-Shot Progression Assessment in Irreversible Diseases
Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna（维也纳医科大学生物医学成像与图像引导治疗系计算成像研究实验室）；Comprehensive Center for Artificial Intelligence in Medicine, Medical University of Vienna（维也纳医科大学综合医学人工智能中心）；Division of Rheumatology, Department of Medicine III, Medical University of Vienna（维也纳医科大学第三内科风湿病科）；Johnson & Johnson（强生公司）；Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital（麻省总医院Athinoula A. Martinos生物医学成像中心）；Ludwig Boltzmann Institute of Arthritis and Rehabilitation（路德维希·玻尔兹曼关节炎与康复研究所）
Johns Hopkins University（约翰斯·霍普金斯大学）；Technical University of Munich（慕尼黑工业大学）；University of Maryland, School of Medicine（马里兰大学医学院）
Pelvic ring disruptions result from blunt injury mechanisms and are often found in patients with multi-system trauma. To grade pelvic fracture severity in trauma victims based on whole-body CT, the Tile AO/OTA classification is frequently used. Due to the high volume of whole-body trauma CTs generated in busy trauma centers, an automated approach to Tile classification would provide substantial value, e.,g., to prioritize the reading queue of the attending trauma radiologist. In such scenario, an automated method should perform grading based on a transparent process and based on interpretable …
Seoul National University Hospital（首尔大学医院）；Massachusetts General Hospital（麻省总医院）；Kyungpook National University（庆北国立大学）；Yeungnam University College of Medicine（岭南大学医学院）；Catholic University of Daegu School of Medicine（大邱加图立大学医学院）；Keimyung University School of Medicine（启明大学医学院）
Purpose. Imaging plays an important role in assessing severity of COVID 19 pneumonia. However, semantic interpretation of chest radiography (CXR) findings does not include quantitative description of radiographic opacities. Most current AI assisted CXR image analysis framework do not quantify for regional variations of disease. To address these, we proposed a four region lung segmentation method to assist accurate quantification of COVID 19 pneumonia. Methods. A segmentation model to separate left and right lung is firstly applied, and then a carina and left hilum detection network is used, wh…
Celiac Disease (CD) is a chronic autoimmune disease that affects the small intestine in genetically predisposed children and adults. Gluten exposure triggers an inflammatory cascade which leads to compromised intestinal barrier function. If this enteropathy is unrecognized, this can lead to anemia, decreased bone density, and, in longstanding cases, intestinal cancer. The prevalence of the disorder is 1% in the United States. An intestinal (duodenal) biopsy is considered the "gold standard" for diagnosis. The mild CD might go unnoticed due to non-specific clinical symptoms or mild histologic f…
Ulcerative colitis (UC) is a chronic inflammatory bowel disease characterized by relapsing inflammation of the large intestine. The severity of UC is often represented by the Mayo Endoscopic Subscore (MES) which quantifies mucosal disease activity from endoscopy videos. In clinical trials, an endoscopy video is assigned an MES based upon the most severe disease activity observed in the video. For this reason, severe inflammation spread throughout the colon will receive the same MES as an otherwise healthy colon with severe inflammation restricted to a small, localized segment. Therefore, the e…
Government Medical College, Thiruvananthapuram（特里凡得琅政府医学院）；Hospital Universitario Puerta de Hierro（普埃尔塔德耶罗大学医院）
Ultrasound is fast becoming an inevitable diagnostic tool for regular and continuous monitoring of the lung with the recent outbreak of COVID-19. In this work, a novel approach is presented to extract acoustic propagation-based features to automatically highlight the region below pleura, which is an important landmark in lung ultrasound (LUS). Subsequently, a multichannel input formed by using the acoustic physics-based feature maps is fused to train a neural network, referred to as LUSNet, to classify the LUS images into five classes of varying severity of lung infection to track the progress…
Rutgers University（罗格斯大学）；Rutgers Robert Wood Johnson Medical School（罗格斯罗伯特·伍德·约翰逊医学院）
Non-alcoholic fatty liver disease (NAFLD) is one of the most common causes of chronic liver diseases (CLD) which can progress to liver cancer. The severity and treatment of NAFLD is determined by NAFLD Activity Scores (NAS)and liver fibrosis stage, which are usually obtained from liver biopsy. However, biopsy is invasive in nature and involves risk of procedural complications. Current methods to predict the fibrosis and NAS scores from noninvasive CT images rely heavily on either a large annotated dataset or transfer learning using pretrained networks. However, the availability of a large anno…
CAD-RADS scoring of coronary CT angiography with Multi-Axis Vision Transformer: a clinically-inspired deep learning pipeline
University of Pavia（帕维亚大学）；Centro Cardiologico Monzino IRCCS（蒙齐诺心脏病学中心IRCCS）；University of Milan（米兰大学）；IRCCS Istituti Clinici Scientifici Maugeri（IRCCS莫杰里科学临床研究所）
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；Siemens Healthcare GmbH（西门子医疗有限公司）；Das Radiologische Zentrum - Radiology Center（放射学中心）
With coronary artery disease (CAD) persisting to be one of the leading causes of death worldwide, interest in supporting physicians with algorithms to speed up and improve diagnosis is high. In clinical practice, the severeness of CAD is often assessed with a coronary CT angiography (CCTA) scan and manually graded with the CAD-Reporting and Data System (CAD-RADS) score. The clinical questions this score assesses are whether patients have CAD or not (rule-out) and whether they have severe CAD or not (hold-out). In this work, we reach new state-of-the-art performance for automatic CAD-RADS scori…
Waterloo Artificial Intelligence Institute, University of Waterloo（滑铁卢大学滑铁卢人工智能研究院）；DarwinAI Corp.（DarwinAI公司）；Vision and Image Processing Research Group, University of Waterloo（滑铁卢大学视觉与图像处理研究组）
As the COVID-19 pandemic continues to devastate globally, one promising field of research is machine learning-driven computer vision to streamline various parts of the COVID-19 clinical workflow. These machine learning methods are typically stand-alone models designed without consideration for the integration necessary for real-world application workflows. In this study, we take a machine learning and systems (MLSys) perspective to design a system for COVID-19 patient screening with the clinical workflow in mind. The COVID-Net system is comprised of the continuously evolving COVIDx dataset, CO…
