Give me a knee radiograph, I will tell you where the knee joint area is: a deep convolutional neural network adventure
Mayo Clinic（梅奥诊所）；Case Western Reserve University（凯斯西储大学）；University of Southern Maine（南缅因大学）；Dubyak Center for Digital Science and Innovation, University of Southern Maine（南缅因大学Dubyak数字科学与创新中心）；Department of Artificial Intelligence and Informatics, Mayo Clinic（梅奥诊所人工智能与信息学系）；Department of Health Sciences Research, Mayo Clinic（梅奥诊所健康科学研究系）；Department of Computer and Data Sciences, Case Western Reserve University（凯斯西储大学计算机与数据科学系）；Department of Orthopedics, Mayo Clinic（梅奥诊所骨科系）；Department of Computer Science, University of Southern Maine（南缅因大学计算机科学系）
Shi Yan, Taghi Ramazanian, Elham Sagheb, Walter K. Kremers, Vipin Chaudhary, Michael Taunton, Hilal Maradit Kremers, Ahmad P. Tafti
Knee pain is undoubtedly the most common musculoskeletal symptom that impairs quality of life, confines mobility and functionality across all ages. Knee pain is clinically evaluated by routine radiographs, where the widespread adoption of radiographic images and their availability at low cost, make them the principle component in the assessment of knee pain and knee pathologies, such as arthritis, trauma, and sport injuries. However, interpretation of the knee radiographs is still highly subjective, and overlapping structures within the radiographs and the large volume of images needing to be analyzed on a daily basis, make interpretation challenging for both naive and experienced practitioners. There is thus a need to implement an artificial intelligence strategy to objectively and automatically interpret knee radiographs, facilitating triage of abnormal radiographs in a timely fashion. The current work proposes an accurate and effective pipeline for autonomous detection, localization, and classification of knee joint area in plain radiographs combining the You Only Look Once (YOLO v3) deep convolutional neural network with a large and fully-annotated knee radiographs dataset. The present work is expected to stimulate more interest from the deep learning computer vision community to this pragmatic and clinical application.
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）；Medical Research Center, University of Oulu and Oulu University Hospital（奥卢大学与奥卢大学医院医学研究中心）
Objective: To assess the ability of imaging-based deep learning to predict radiographic patellofemoral osteoarthritis (PFOA) from knee lateral view radiographs. Design: Knee lateral view radiographs were extracted from The Multicenter Osteoarthritis Study (MOST) (n = 18,436 knees). Patellar region-of-interest (ROI) was first automatically detected, and subsequently, end-to-end deep convolutional neural networks (CNNs) were trained and validated to detect the status of patellofemoral OA. Patellar ROI was detected using deep-learning-based object detection method. Manual PFOA status assessment p…
Deep Learning-based Alignment Measurement in Knee Radiographs
Division of Informatics, Imaging and Data Sciences, The University of Manchester（信息学与数据科学系，曼彻斯特大学）；Northern Care Alliance NHS Foundation Trust（北护理联盟国家健康服务信托基金）；Department of Trauma and Orthopaedics, Stockport NHS Foundation Trust（创伤与骨科部门，史托波特国家健康服务信托基金）；School of Health and Society, University of Salford（健康与社会学院，萨尔福德大学）；School of Biological Sciences, The University of Manchester（生物科学学院，曼彻斯特大学）；Research Unit of Health Sciences and Technology, University of Oulu（健康科学与技术研究单位，奥卢大学）
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）
Knee osteoarthritis (OA) is the most common musculoskeletal disease in the world. In primary healthcare, knee OA is diagnosed using clinical examination and radiographic assessment. Osteoarthritis Research Society International (OARSI) atlas of OA radiographic features allows to perform independent assessment of knee osteophytes, joint space narrowing and other knee features. This provides a fine-grained OA severity assessment of the knee, compared to the gold standard and most commonly used Kellgren-Lawrence (KL) composite score. However, both OARSI and KL grading systems suffer from moderate…
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）
Osteoarthritis (OA) is a common musculoskeletal condition typically diagnosed from radiographic assessment after clinical examination. However, a visual evaluation made by a practitioner suffers from subjectivity and is highly dependent on the experience. Computer-aided diagnostics (CAD) could improve the objectivity of knee radiographic examination. The first essential step of knee OA CAD is to automatically localize the joint area. However, according to the literature this task itself remains challenging. The aim of this study was to develop novel and computationally efficient method to tack…
The severity of knee osteoarthritis is graded using the 5-point Kellgren-Lawrence (KL) scale where healthy knees are assigned grade 0, and the subsequent grades 1-4 represent increasing severity of the affliction. Although several methods have been proposed in recent years to develop models that can automatically predict the KL grade from a given radiograph, most models have been developed and evaluated on datasets not sourced from India. These models fail to perform well on the radiographs of Indian patients. In this paper, we propose a novel method using convolutional neural networks to auto…
Insight Centre for Data Analytics（洞察数据分析中心）；Dublin City University（都柏林城市大学）
This chapter presents the investigations and the results of feature learning using convolutional neural networks to automatically assess knee osteoarthritis (OA) severity and the associated clinical and diagnostic features of knee OA from X-ray images. Also, this chapter demonstrates that feature learning in a supervised manner is more effective than using conventional handcrafted features for automatic detection of knee joints and fine-grained knee OA image classification. In the general machine learning approach to automatically assess knee OA severity, the first step is to localize the regi…
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）；Erasmus MC, University Medical Center（伊拉斯谟医学中心大学医院）；Medical Research Center, University of Oulu and Oulu University Hospital（奥卢大学与奥卢大学医院医学研究中心）
The purposes of this study were to investigate: 1) the effect of placement of region-of-interest (ROI) for texture analysis of subchondral bone in knee radiographs, and 2) the ability of several texture descriptors to distinguish between the knees with and without radiographic osteoarthritis (OA). Bilateral posterior-anterior knee radiographs were analyzed from the baseline of OAI and MOST datasets. A fully automatic method to locate the most informative region from subchondral bone using adaptive segmentation was developed. We used an oversegmentation strategy for partitioning knee images int…
Insight Centre for Data Analytics, Dublin City University（都柏林城市大学数据洞察中心）；School of Health and Human Performance, Dublin City University（都柏林城市大学健康与人体表现学院）
This paper proposes a new approach to automatically quantify the severity of knee osteoarthritis (OA) from radiographs using deep convolutional neural networks (CNN). Clinically, knee OA severity is assessed using Kellgren \& Lawrence (KL) grades, a five point scale. Previous work on automatically predicting KL grades from radiograph images were based on training shallow classifiers using a variety of hand engineered features. We demonstrate that classification accuracy can be significantly improved using deep convolutional neural network models pre-trained on ImageNet and fine-tuned on knee O…
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）；Medical Research Center, University of Oulu and Oulu University Hospital（奥卢大学与奥卢大学医院医学研究中心）
Knee osteoarthritis (OA) is very common progressive and degenerative musculoskeletal disease worldwide creates a heavy burden on patients with reduced quality of life and also on society due to financial impact. Therefore, any attempt to reduce the burden of the disease could help both patients and society. In this study, we propose a fully automated novel method, based on combination of joint shape and convolutional neural network (CNN) based bone texture features, to distinguish between the knee radiographs with and without radiographic osteoarthritis. Moreover, we report the first attempt a…
VRVis Center for Virtual Reality and Visualization（VRVis虚拟现实与可视化中心）；Braincon Handels-GmbH（Braincon贸易有限公司）；NOVA Medical School, Universidade Nova de Lisboa（新里斯本大学NOVA医学院）；Instituto de Medicina Molecular（分子医学研究所）；Centro Hospitalar Lisboa Ocidental（里斯本西部医疗中心）
The relationship between knee osteoarthritis progression and changes in tibial bone structure has long been recognized and various texture descriptors have been proposed to detect early osteoarthritis (OA) from radiographs. This work aims to investigate (1) femoral textures as an OA indicator and (2) the potential of entropy as a computationally efficient alternative to established texture descriptors. We design a robust semi-automatically placed layout for regions of interest (ROI), compute the Hurst coefficient and the entropy in each ROI, and employ statistical and machine learning methods …
University of Oulu（奥卢大学）；Tampere University of Technology（坦佩雷理工大学）；Oulu University Hospital（奥卢大学医院）
Knee osteoarthritis (OA) is the most common musculoskeletal disorder. OA diagnosis is currently conducted by assessing symptoms and evaluating plain radiographs, but this process suffers from subjectivity. In this study, we present a new transparent computer-aided diagnosis method based on the Deep Siamese Convolutional Neural Network to automatically score knee OA severity according to the Kellgren-Lawrence grading scale. We trained our method using the data solely from the Multicenter Osteoarthritis Study and validated it on randomly selected 3,000 subjects (5,960 knees) from Osteoarthritis …
Landmark-free Assessment of Lower-limb Alignment with Implicit Neural Shape Functions from Knee Radiographs
Division of Informatics, Imaging and Data Sciences, The University of Manchester（曼彻斯特大学信息学、影像与数据科学部）；Research Unit of Health Sciences and Technology, University of Oulu（奥卢大学健康科学与技术研究部）；Medical Research Center Oulu, University of Oulu and Oulu University Hospital（奥卢大学与奥卢大学医院医学研究中心）；Department of Trauma and Orthopaedics, Stockport NHS Foundation Trust, Stepping Hill Hospital（斯泰平希尔医院斯托克波特NHS基金会创伤与骨科）；School of Health and Society, University of Salford（索尔福德大学健康与社会学院）；School of Biological Sciences, The University of Manchester（曼彻斯特大学生物科学学院）；Weill Cornell Medicine, Cornell University（康奈尔大学威尔康奈尔医学院）
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）；Erasmus MC, University Medical Center Rotterdam（伊拉斯谟医学中心，鹿特丹大学医学中心）；University Medical Center Rotterdam（鹿特丹大学医学中心）；Tampere University of Technology（坦佩雷理工大学）
Knee osteoarthritis (OA) is the most common musculoskeletal disease without a cure, and current treatment options are limited to symptomatic relief. Prediction of OA progression is a very challenging and timely issue, and it could, if resolved, accelerate the disease modifying drug development and ultimately help to prevent millions of total joint replacement surgeries performed annually. Here, we present a multi-modal machine learning-based OA progression prediction model that utilizes raw radiographic data, clinical examination results and previous medical history of the patient. We validate…
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）；KU Leuven（鲁汶大学）；Ailean Technologies Oy
Knee osteoarthritis (OA) is one of the highest disability factors in the world. This musculoskeletal disorder is assessed from clinical symptoms, and typically confirmed via radiographic assessment. This visual assessment done by a radiologist requires experience, and suffers from moderate to high inter-observer variability. The recent literature has shown that deep learning methods can reliably perform the OA severity assessment according to the gold standard Kellgren-Lawrence (KL) grading system. However, these methods require large amounts of labeled data, which are costly to obtain. In thi…
Opportunistic Bone-Loss Screening from Routine Knee Radiographs Using a Multi-Task Deep Learning Framework with Sensitivity-Constrained Threshold Optimization
ORBIT Lab, College of Medicine and Biological Information Engineering, Northeastern University（ORBIT实验室，医学院和生物信息工程学院，东北大学）；Department of Radiology, Liaoning Provincial Key Laboratory of Medical Imaging, Liaoning Provincial Key Laboratory of Imaging Technology and Artificial Intelligence, Shengjing Hospital of China Medical University（放射科，辽宁省医学影像重点实验室，辽宁省影像技术与人工智能重点实验室，中国医科大学盛京医院）；Rehabilitation Center, Liaoning Provincial Key Laboratory of Medical Imaging, Liaoning Provincial Key Laboratory of Imaging Technology and Artificial Intelligence, Shengjing Hospital of China Medical University（康复中心，辽宁省医学影像重点实验室，辽宁省影像技术与人工智能重点实验室，中国医科大学盛京医院）；The University of Sydney, Sydney Musculoskeletal Health and the Kolling Institute, Northern Clinical School, Faculty of Medicine and Health and the Northern Sydney Local Health District（悉尼大学，悉尼骨科健康与Kolling研究所，北方临床医学院，医学院与健康学院，北悉尼地方卫生区）
Feasibility Study of a Diffusion-Based Model for Cross-Modal Generation of Knee MRI from X-ray: Integrating Radiographic Feature Information
Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；University Sorbonne Paris Nord（巴黎北大索邦大学）；German Cancer Research Center（德国癌症研究中心）；Jiangsu Institute of Hematology（江苏血液学研究所）；The First Affiliated Hospital of Soochow University（苏州大学附属第一医院）；Henan University of Chinese Medicine（河南中医药大学）；Athinoula A. Martinos Centre for Biomedical Imaging（阿西努拉·A.马蒂诺斯生物医学成像中心）；IDP Institute（IDP研究所）；University of Orleans（奥尔良大学）
Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data and Symptomatic Assessments
University of Oulu（奥卢大学）；Lund University（隆德大学）；Diakonhjemmet Hospital（迪亚科涅米特医院）；Juntendo University（顺天堂大学）；Oulu University Hospital（奥卢大学医院）
A Progressive Risk Formulation for Enhanced Deep Learning based Total Knee Replacement Prediction in Knee Osteoarthritis
Center for Data Science, New York University（纽约大学数据科学中心）；Department of Radiology, New York University Langone Health（纽约大学朗格尼健康放射科）；Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Langone Health（纽约大学朗格尼健康伯纳德与艾琳·施瓦茨生物医学影像中心）
Knee-xRAI: An Explainable AI Framework for Automatic Kellgren-Lawrence Grading of Knee Osteoarthritis
Orthopaedic Department, Faculty of Medicine UIN Syarif Hidayatullah Jakarta（乌姆尼大学医学学院骨科部）；Informatics Engineering, Institut Teknologi Sepuluh Nopember（十月份技术研究所信息工程系）；Information Technology, Universitas Muhammadiyah Yogyakarta（尤科阿卡塔大学信息技术系）；Industrial and Systems Engineering, King Fahd University of Petroleum and Minerals（国王法赫德石油与矿物大学工业与系统工程系）
The postoperative range of motion is one of the crucial factors indicating the outcome of Total Knee Arthroplasty (TKA). Although the correlation between range of knee flexion and posterior condylar offset (PCO) is controversial in the literature, PCO maintains its importance on evaluation of TKA. Due to limitations on PCO measurement, two novel parameters, posterior condylar offset ratio (PCOR) and anterior condylar offset ratio (ACOR), were introduced. Nowadays, the calculation of PCOR and ACOR on plain lateral radiographs is done manually by orthopedic surgeons. In this regard, we developed…
University of Oulu（奥卢大学）；Oulu University Hospital（奥卢大学医院）；Medical Research Center（医学研究中心）
Objective is to assess the ability of texture features for detecting radiographic patellofemoral osteoarthritis (PFOA) from knee lateral view radiographs. We used lateral view knee radiographs from MOST public use datasets (n = 5507 knees). Patellar region-of-interest (ROI) was automatically detected using landmark detection tool (BoneFinder). Hand-crafted features, based on LocalBinary Patterns (LBP), were then extracted to describe the patellar texture. First, a machine learning model (Gradient Boosting Machine) was trained to detect radiographic PFOA from the LBP features. Furthermore, we u…
Self-Supervised Learning for Knee Osteoarthritis: Diagnostic Limitations and Prognostic Value of Hospital Data
Department of Physics, J.K. Institute of Science（物理系，J.K. 科学研究所）；World Scientific University（世界科学大学）；University of Intelligent Studies（智能研究大学）；Center for Data Science, New York University（数据科学中心，纽约大学）；Bernard and Irene Schwartz Center for Biomedical Imaging, New York University Langone Health（伯纳德和艾琳·施瓦茨生物医学成像中心，纽约大学朗格尼健康中心）；Department of Radiology, New York University Langone Health（放射学系，纽约大学朗格尼健康中心）；Perlmutter Cancer Center, New York University Langone Health（珀尔马特癌症中心，纽约大学朗格尼健康中心）
Duke University（杜克大学）；Duke Clinical Research Institute（杜克临床研究所）；Duke-Margolis Center for Health Policy（杜克-马戈利斯卫生政策中心）；Duke Cancer Institute（杜克癌症研究所）
The assessment of knee osteoarthritis (KOA) severity on knee X-rays is a central criteria for the use of total knee arthroplasty. However, this assessment suffers from imprecise standards and a remarkably high inter-reader variability. An algorithmic, automated assessment of KOA severity could improve overall outcomes of knee replacement procedures by increasing the appropriateness of its use. We propose a novel deep learning-based five-step algorithm to automatically grade KOA from posterior-anterior (PA) views of radiographs: (1) image preprocessing (2) localization of knees joints in the im…
Knee Osteoarthritis Severity Prediction using an Attentive Multi-Scale Deep Convolutional Neural Network
Indian Institute of Technology Guwahati（印度古瓦哈蒂印度理工学院）；Cleveland Clinic（克利夫兰诊所）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）；National University of Singapore（新加坡国立大学）
PAII Inc.（PAII 公司）；Chang Gung Memorial Hospital（长庚纪念医院）；Ping An Technology（平安科技）
Knee osteoarthritis (OA) is a common degenerate joint disorder that affects a large population of elderly people worldwide. Accurate radiographic assessment of knee OA severity plays a critical role in chronic patient management. Current clinically-adopted knee OA grading systems are observer subjective and suffer from inter-rater disagreements. In this work, we propose a computer-aided diagnosis approach to provide more accurate and consistent assessments of both composite and fine-grained OA grades simultaneously. A novel semi-supervised learning method is presented to exploit the underlying…
H-SemiS: Hierarchical Fusion of Semi and Self-Supervised Learning for Knee Osteoarthritis Severity Grading
Department of Computer Science and Engineering, Indian Institute of Technology (IIT) Indore, Indore 453552, India（印度理工学院Indore计算机科学与工程系）；Department of Computer Science and Engineering, National Institute of Technology Tiruchirappalli, Tiruchirappalli 620015, India（印度理工学院Tiruchirappalli计算机科学与工程系）
From Kellgren-Lawrence to Calcium Pyrophosphate Crystal Deposition: A Soft-Labelling Framework for Knee Osteoarthritis Assessmen
organization= Department of Political Science, Communication；International Relations, University of Macerata , city= Macerata , country= Italy；organization= Department of Economics；Law, University of Macerata , city= Macerata , country= Italy；organization= Department of Innovative Technologies in Medicine \& Dentistry, Università degli Studi "G. D'Annunzio" Chieti - Pescara , city= Chieti , country= Italy；organization= Department of Internal Medicine, Azienda Ospedaliero Universitaria delle Marche , city = Ancona , country= Italy；organization= Academic Rheumatology, University of Nottingham , city = Nottingham , country= UK；organization= Department of Rheumatology, Polytechnic University of Marche , city= Ancona , country= Italy
Background: Object detection in radiograph computer vision has largely benefited from progress in deep convolutional neural networks and can, for example, annotate a radiograph with a box around a knee joint or intervertebral disc. Is deep learning capable of detect small (less than 1% of the image) in radiographs? And how many radiographs do we need use when re-training a deep learning model? Methods: We annotated 396 radiographs of left and right carpi dorsal 75 medial to palmarolateral oblique (DMPLO) projection with the location of radius, proximal row of carpal bones, distal row of carpal…
Rutgers University（罗格斯大学）；SenseTime Research（商汤科技研究院）；New Jersey Medical School（新泽西医学院）
The 3D morphology and quantitative assessment of knee articular cartilages (i.e., femoral, tibial, and patellar cartilage) in magnetic resonance (MR) imaging is of great importance for knee radiographic osteoarthritis (OA) diagnostic decision making. However, effective and efficient delineation of all the knee articular cartilages in large-sized and high-resolution 3D MR knee data is still an open challenge. In this paper, we propose a novel framework to solve the MR knee cartilage segmentation task. The key contribution is the adversarial learning based collaborative multi-agent segmentation …
RSIP Vision（RSIP Vision 公司）；Weizmann Institute of Science（魏茨曼科学研究所）
We present an end-to-end Convolutional Neural Network (CNN) approach for 3D reconstruction of knee bones directly from two bi-planar X-ray images. Clinically, capturing the 3D models of the bones is crucial for surgical planning, implant fitting, and postoperative evaluation. X-ray imaging significantly reduces the exposure of patients to ionizing radiation compared to Computer Tomography (CT) imaging, and is much more common and inexpensive compared to Magnetic Resonance Imaging (MRI) scanners. However, retrieving 3D models from such 2D scans is extremely challenging. In contrast to the commo…
Adaptive Variance Thresholding: A Novel Approach to Improve Existing Deep Transfer Vision Models and Advance Automatic Knee-Joint Osteoarthritis Classification
University of Jyväskylä（于韦斯屈莱大学）；University of Helsinki（赫尔辛基大学）
