This work proposes a novel end-to-end convolutional neural network (CNN) architecture to automatically quantify the severity of knee osteoarthritis (OA) using X-Ray images, which incorporates trainable attention modules acting as unsupervised fine-grained detectors of the region of interest (ROI). The proposed attention modules can be applied at different levels and scales across any CNN pipeline helping the network to learn relevant attention patterns over the most informative parts of the image at different resolutions. We test the proposed attention mechanism on existing state-of-the-art CNN architectures as our base models, achieving promising results on the benchmark knee OA datasets from the osteoarthritis initiative (OAI) and multicenter osteoarthritis study (MOST). All code from our experiments will be publicly available on the github repository: https://github.com/marc-gorriz/KneeOA-CNNAttention
Duke University(杜克大学);Duke Clinical Research Institute(杜克临床研究所);Duke-Margolis Center for Health Policy(杜克-马戈利斯卫生政策中心);Duke Cancer Institute(杜克癌症研究所)
The assessment of knee osteoarthritis (KOA) severity on knee X-rays is a central criteria for the use of total knee arthroplasty. However, this assessment suffers from imprecise standards and a remarkably high inter-reader variability. An algorithmic, automated assessment of KOA severity could improve overall outcomes of knee replacement procedures by increasing the appropriateness of its use. We propose a novel deep learning-based five-step algorithm to automatically grade KOA from posterior-anterior (PA) views of radiographs: (1) image preprocessing (2) localization of knees joints in the im…
Insight Centre for Data Analytics(洞察数据分析中心);National University of Ireland Galway(爱尔兰国立高威大学);Dublin City University(都柏林城市大学);School of Health and Human Performance(健康与人类表现学院);ZB MED – Information Centre for Life Sciences(ZB MED——生命科学信息中心);University of Cologne(科隆大学);School of Mathematics, Statistics and Applied Mathematics(数学、统计与应用数学学院)
Knee osteoarthritis (KOA) is a disease that impairs knee function and causes pain. A radiologist reviews knee X-ray images and grades the severity level of the impairments according to the Kellgren and Lawrence grading scheme; a five-point ordinal scale (0--4). In this study, we used Elastic Net (EN) and Random Forests (RF) to build predictive models using patient assessment data (i.e. signs and symptoms of both knees and medication use) and a convolution neural network (CNN) trained using X-ray images only. Linear mixed effect models (LMM) were used to model the within subject correlation bet…
University of Oulu(奥卢大学);Oulu University Hospital(奥卢大学医院);KU Leuven(鲁汶大学);Ailean Technologies Oy
Knee osteoarthritis (OA) is one of the highest disability factors in the world. This musculoskeletal disorder is assessed from clinical symptoms, and typically confirmed via radiographic assessment. This visual assessment done by a radiologist requires experience, and suffers from moderate to high inter-observer variability. The recent literature has shown that deep learning methods can reliably perform the OA severity assessment according to the gold standard Kellgren-Lawrence (KL) grading system. However, these methods require large amounts of labeled data, which are costly to obtain. In thi…
Rethinking Knee Osteoarthritis Severity Grading: A Few Shot Self-Supervised Contrastive Learning Approach
Science Foundation Ireland Centre for Research Training in Machine Learning(爱尔兰科学基金会机器学习研究培训中心);School of Medicine(医学院);School of Computer Science, University College Dublin(都柏林大学学院计算机科学学院);Insight Centre for Data Analytics, University College Dublin(都柏林大学学院洞察数据分析中心)
Knee Osteoarthritis Severity Prediction using an Attentive Multi-Scale Deep Convolutional Neural Network
Indian Institute of Technology Guwahati(印度古瓦哈蒂印度理工学院);Cleveland Clinic(克利夫兰诊所);Duke-NUS Medical School(杜克-新加坡国立大学医学院);National University of Singapore(新加坡国立大学)
The severity of knee osteoarthritis is graded using the 5-point Kellgren-Lawrence (KL) scale where healthy knees are assigned grade 0, and the subsequent grades 1-4 represent increasing severity of the affliction. Although several methods have been proposed in recent years to develop models that can automatically predict the KL grade from a given radiograph, most models have been developed and evaluated on datasets not sourced from India. These models fail to perform well on the radiographs of Indian patients. In this paper, we propose a novel method using convolutional neural networks to auto…
PAII Inc.(PAII 公司);Chang Gung Memorial Hospital(长庚纪念医院);Ping An Technology(平安科技)
Knee osteoarthritis (OA) is a common degenerate joint disorder that affects a large population of elderly people worldwide. Accurate radiographic assessment of knee OA severity plays a critical role in chronic patient management. Current clinically-adopted knee OA grading systems are observer subjective and suffer from inter-rater disagreements. In this work, we propose a computer-aided diagnosis approach to provide more accurate and consistent assessments of both composite and fine-grained OA grades simultaneously. A novel semi-supervised learning method is presented to exploit the underlying…
Parkinson's disease (PD) is a progressive neurological disorder primarily affecting motor function resulting in tremor at rest, rigidity, bradykinesia, and postural instability. The physical severity of PD impairments can be quantified through the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), a widely used clinical rating scale. Accurate and quantitative assessment of disease progression is critical to developing a treatment that slows or stops further advancement of the disease. Prior work has mainly focused on dopamine transport neuroimaging for diagnosis or…
University of Oulu(奥卢大学);Oulu University Hospital(奥卢大学医院)
Knee osteoarthritis (OA) is the most common musculoskeletal disease in the world. In primary healthcare, knee OA is diagnosed using clinical examination and radiographic assessment. Osteoarthritis Research Society International (OARSI) atlas of OA radiographic features allows to perform independent assessment of knee osteophytes, joint space narrowing and other knee features. This provides a fine-grained OA severity assessment of the knee, compared to the gold standard and most commonly used Kellgren-Lawrence (KL) composite score. However, both OARSI and KL grading systems suffer from moderate…
Institute for Medical Imaging Technology, School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学医学院生物医学工程学院医学影像技术研究所);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能科技有限公司);Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属同仁医院影像科)
Knee osteoarthritis (OA) is one of the most common musculoskeletal disorders and requires early-stage diagnosis. Nowadays, the deep convolutional neural networks have achieved greatly in the computer-aided diagnosis field. However, the construction of the deep learning models usually requires great amounts of annotated data, which is generally high-cost. In this paper, we propose a novel approach for knee cartilage defects assessment, including severity classification and lesion localization. This can be treated as a subtask of knee OA diagnosis. Particularly, we design a self-ensembling frame…
Temporal Evolution of Knee Osteoarthritis: A Diffusion-based Morphing Model for X-ray Medical Image Synthesis
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Orleans(奥尔良大学);IDP Institute(IDP研究所);Jiangsu Institute of Hematology(江苏省血液研究所);First Affiliated Hospital of Soochow University(苏州大学附属第一医院);Cancer Hospital of Pernambuco(伯南布哥癌症医院)
University of California, San Francisco(加州大学旧金山分校)
Purpose: To evaluate the diagnostic utility of two convolutional neural networks (CNNs) for severity staging of anterior cruciate ligament (ACL) injuries. Materials and Methods: This retrospective analysis was conducted on 1243 knee MR images (1008 intact, 18 partially torn, 77 fully torn, and 140 reconstructed ACLs) from 224 patients (age 47 +/- 14 years, 54% women) acquired between 2011 and 2014. The radiologists used a modified scoring metric. To classify ACL injuries with deep learning, two types of CNNs were used, one with three-dimensional (3D) and the other with two-dimensional (2D) con…
Vision Transformer-based Model for Severity Quantification of Lung Pneumonia Using Chest X-ray Images
University of the Basque Country(巴斯克大学);IKERBASQUE;Ho Chi Minh City Open University(胡志明市开放大学);University of Strasbourg(斯特拉斯堡大学);INSERM(法国国家健康与医学研究院);Université de Haute-Alsace(上阿尔萨斯大学)
本文提出 ViTReg-IP,一种由 ViT 与回归头构成的轻量模型,用于根据胸部 X 光量化 COVID-19 等肺病严重程度,并在多来源数据集上验证其低成本、高性能与泛化性。
National Institute of Technology Delhi(德里国家理工学院);Indian Institute of Technology, Roorkee(鲁尔基印度理工学院)
Background and Objective: During pandemics, the use of artificial intelligence (AI) approaches combined with biomedical science play a significant role in reducing the burden on the healthcare systems and physicians. The rapid increment in cases of COVID-19 has led to an increase in demand for hospital beds and other medical equipment. However, since medical facilities are limited, it is recommended to diagnose patients as per the severity of the infection. Keeping this in mind, we share our research in detecting COVID-19 as well as assessing its severity using chest-CT scans and Deep Learning…
Multi-Dataset Multi-Task Learning for COVID-19 Prognosis
Unit of Computer Systems \& Bioinformatics, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy College of Computer Science;Software Engineering, Shenzhen University, Shenzhen, China Department of Electrical Engineering, City University of Hong Kong, Hong Kong, China
Saratoga High School(萨拉托加高中);Stanford University(斯坦福大学)
Chest X-rays of coronavirus disease 2019 (COVID-19) patients are frequently obtained to determine the extent of lung disease and are a valuable source of data for creating artificial intelligence models. Most work to date assessing disease severity on chest imaging has focused on segmenting computed tomography (CT) images; however, given that CTs are performed much less frequently than chest X-rays for COVID-19 patients, automated lung lesion segmentation on chest X-rays could be clinically valuable. There currently exists a universal shortage of chest X-rays with ground truth COVID-19 lung le…