Attention-Guided Discriminative Region Localization and Label Distribution Learning for Bone Age Assessment
University of California Los Angeles（加州大学洛杉矶分校）；Zhejiang University（浙江大学）；The First Affiliated Hospital, College of Medicine, Zhejiang University（浙江大学医学院附属第一医院）
Chao Chen, Zhihong Chen, Xinyu Jin, Lanjuan Li, William Speier, Corey W. Arnold
Bone age assessment (BAA) is clinically important as it can be used to diagnose endocrine and metabolic disorders during child development. Existing deep learning based methods for classifying bone age use the global image as input, or exploit local information by annotating extra bounding boxes or key points. However, training with the global image underutilizes discriminative local information, while providing extra annotations is expensive and subjective. In this paper, we propose an attention-guided approach to automatically localize the discriminative regions for BAA without any extra annotations. Specifically, we first train a classification model to learn the attention maps of the discriminative regions, finding the hand region, the most discriminative region (the carpal bones), and the next most discriminative region (the metacarpal bones). Guided by those attention maps, we then crop the informative local regions from the original image and aggregate different regions for BAA. Instead of taking BAA as a general regression task, which is suboptimal due to the label ambiguity problem in the age label space, we propose using joint age distribution learning and expectation regression, which makes use of the ordinal relationship among hand images with different individual ages and leads to more robust age estimation. Extensive experiments are conducted on the RSNA pediatric bone age data set. Using no training annotations, our method achieves competitive results compared with existing state-of-the-art semi-automatic deep learning-based methods that require manual annotation. Code is available at https: //github.com/chenchao666/Bone-Age-Assessment.
Lyft Inc.（Lyft公司）；Neuromation OU（Neuromation公司）；University of Michigan（密歇根大学）；Massachusetts Institute of Technology（麻省理工学院）
Skeletal bone age assessment is a common clinical practice to diagnose endocrine and metabolic disorders in child development. In this paper, we describe a fully automated deep learning approach to the problem of bone age assessment using data from Pediatric Bone Age Challenge organized by RSNA 2017. The dataset for this competition is consisted of 12.6k radiological images of left hand labeled by the bone age and sex of patients. Our approach utilizes several deep learning architectures: U-Net, ResNet-50, and custom VGG-style neural networks trained end-to-end. We use images of whole hands as…
Bone age assessment gives us evidence to analyze the children growth status and the rejuvenation involved chronological and biological ages. All the previous works consider left-hand X-ray image of a child in their works. In this paper, we carry out a study on estimating human age using whole-body bone CT images and a novel convolutional neural network. Our model with additional connections shows an effective way to generate a massive number of vital features while reducing overfitting influence on small training data in the medical image analysis research area. A dataset and a comparison with…
Imsight Medical Technology, Co., Ltd.（深圳视见医疗科技有限公司）；Shenzhen University（深圳大学）；The Chinese University of Hong Kong（香港中文大学）
Bone age is one of the most important indicators for assessing bone's maturity, which can help to interpret human's growth development level and potential progress. In the clinical practice, bone age assessment (BAA) of X-ray images requires the joint consideration of the appearance and location information of hand bones. These kinds of information can be effectively captured by the relation of different anatomical parts of hand bone. Recently developed methods differ mostly in how they model the part relation and choose useful parts for BAA. However, these methods neglect the mining of relati…
Peking University（北京大学）；Yizhun Medical AI Co., Ltd（一准医疗人工智能有限公司）
Skeletal bone age assessment (BAA), as an essential imaging examination, aims at evaluating the biological and structural maturation of human bones. In the clinical practice, Tanner and Whitehouse (TW2) method is a widely-used method for radiologists to perform BAA. The TW2 method splits the hands into Region Of Interests (ROI) and analyzes each of the anatomical ROI separately to estimate the bone age. Because of considering the analysis of local information, the TW2 method shows accurate results in practice. Following the spirit of TW2, we propose a novel model called Anatomical Local-Aware …
Bone age assessment is an important clinical trial to measure skeletal child maturity and diagnose of growth disorders. Conventional approaches such as the Tanner-Whitehouse (TW) and Greulich and Pyle (GP) may not perform well due to their large inter-observer and intra-observer variations. In this paper, we propose a finger joint localization strategy to filter out most non-informative parts of images. When combining with the conventional full image-based deep network, we observe a much-improved performance. % Our approach utilizes full hand and specific joints images for skeletal maturity pr…
Concordia Institute for Information Systems Engineering（康考迪亚大学信息系统工程研究所）；Concordia University（康考迪亚大学）
Bone age is an important measure for assessing the skeletal and biological maturity of children. Delayed or increased bone age is a serious concern for pediatricians, and needs to be accurately assessed in a bid to determine whether bone maturity is occurring at a rate consistent with chronological age. In this paper, we introduce a unified deep learning framework for bone age assessment using instance segmentation and ridge regression. The proposed approach consists of two integrated stages. In the first stage, we employ an image annotation and segmentation model to annotate and segment the h…
Osteoporosis can be identified by looking at 2D x-ray images of the bone. The high degree of similarity between images of a healthy bone and a diseased one makes classification a challenge. A good bone texture characterization technique is essential for identifying osteoporosis cases. Standard texture feature extraction techniques like Local Binary Pattern (LBP), Gray Level Co-occurrence Matrix (GLCM) have been used for this purpose. In this paper, we draw a comparison between deep features extracted from convolution neural network against these traditional features. Our results show that deep…
BoneAgeTW2: Automated Skeletal Maturation Assessment via the Tanner-Whitehouse 2 Method, Deep Learning, and Clinical Report Generation with Distribution Curves
Manipal Institute of Technology, MAHE（玛尼帕尔高等教育学院马尼帕尔理工学院）
Bone age assessment (BAA) is a standard method for determining the age difference between skeletal and chronological age. Manual processes are complicated and necessitate the expertise of experts. This is where deep learning comes into play. In this study, pre-trained models like VGG-16, InceptionV3, XceptionNet, and MobileNet are used to assess the bone age of the input data, and their mean average errors are compared and evaluated to see which model predicts the best.
Universidad de los Andes（安第斯大学）；Fundación Santa Fe de Bogotá（圣菲波哥大基金会）
Bone Age Assessment (BAA) is a task performed by radiologists to diagnose abnormal growth in a child. In manual approaches, radiologists take into account different identity markers when calculating bone age, i.e., chronological age and gender. However, the current automated Bone Age Assessment methods do not completely exploit the information present in the patient's metadata. With this lack of available methods as motivation, we present SIMBA: Specific Identity Markers for Bone Age Assessment. SIMBA is a novel approach for the task of BAA based on the use of identity markers. For this purpos…
Cornell University（康奈尔大学）；CuraCloud Corporation（库拉克劳德公司）；UNC Charlotte（北卡罗来纳大学夏洛特分校）；University at Albany, State University at New York（纽约州立大学奥尔巴尼分校）
Computerized automatic methods have been employed to boost the productivity as well as objectiveness of hand bone age assessment. These approaches make predictions according to the whole X-ray images, which include other objects that may introduce distractions. Instead, our framework is inspired by the clinical workflow (Tanner-Whitehouse) of hand bone age assessment, which focuses on the key components of the hand. The proposed framework is composed of two components: a Mask R-CNN subnet of pixelwise hand segmentation and a residual attention network for hand bone age assessment. The Mask R-C…
The bone age, reflecting the degree of development of the bones, can be used to predict the adult height and detect endocrine diseases of children. Both examinations of radiologists and variability of operators have a significant impact on bone age assessment. To decrease human intervention , machine learning algorithms are used to assess the bone age automatically. However, conventional supervised deep-learning methods need pre-labeled data. In this paper, based on the convolutional auto-encoder with constraints (CCAE), an unsupervised deep-learning model proposed in the classification of the…
AI-assisted radiographic analysis in detecting alveolar bone-loss severity and patterns
Faculty of Engineering, University of Peradeniya（工程学院，珀德尼亚大学）；Faculty of Dental Sciences, University of Peradeniya（牙科学院，珀德尼亚大学）；Simula Metropolitan Center for Digital Engineering（模拟 Metropolitan 数字工程中心）
An AI-driven Assessment of Bone Density as a Biomarker Leading to the Aging Law
Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系）；Nuclear Medicine Department, Peking Union Medical College Hospital（北京大学医学部核医学科）；Department of Nuclear Medicine, First Affiliated Hospital of Sun Yat-sen University（中山大学第一附属医院核医学科）
VUNO Inc.（VUNO公司）；University of Ulsan, College of Medicine（蔚山大学医学院）；Asan Medical Center（峨山医学中心）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
This study presents a novel approach to bone age assessment (BAA) using a multi-view, multi-task classification model based on the Sauvegrain method. A straightforward solution to automating the Sauvegrain method, which assesses a maturity score for each landmark in the elbow and predicts the bone age, is to train classifiers independently to score each region of interest (RoI), but this approach limits the accessible information to local morphologies and increases computational costs. As a result, this work proposes a self-accumulative vision transformer (SAT) that mitigates anisotropic behav…
Medical University of Graz（格拉茨医科大学）；Graz University of Technology（格拉茨工业大学）；Shanghai Jiao Tong University（上海交通大学）
Computer assisted technologies based on algorithmic software segmentation are an increasing topic of interest in complex surgical cases. However - due to functional instability, time consuming software processes, personnel resources or licensed-based financial costs many segmentation processes are often outsourced from clinical centers to third parties and the industry. Therefore, the aim of this trial was to assess the practical feasibility of an easy available, functional stable and licensed-free segmentation approach to be used in the clinical practice. In this retrospective, randomized, co…
A New Angle on Bones: Robust Pose Estimation in X-Ray and Ultrasound
Medical Informatics, University of Lübeck（吕贝克大学医学信息学系）；Institut of Radiology and Nuclear Medicine, University Hospital Schleswig-Holstein（石勒苏益格-荷尔斯泰因大学医院放射学与核医学研究所）；Paediatric Surgery, University Hospital Schleswig-Holstein（石勒苏益格-荷尔斯泰因大学医院小儿外科）；EchoScout GmbH
Attend-and-Refine: Interactive keypoint estimation and quantitative cervical vertebrae analysis for bone age assessment
Kim Jaechul Graduate School of Artificial Intelligence, KAIST, Daejeon 34141, Republic of Korea（韩国科学技术院人工智能研究生院）；Korea University Anam Hospital, Seoul 02708, Republic of Korea（韩国大学安安医院）；Asan Medical Center, University of Ulsan College of Medicine, Seoul 05505, Republic of Korea（釜山大学医学院_asan医院）
The Hong Kong University of Science and Technology（香港科技大学）；The Hong Kong University（香港大学）；The Hong Kong University of Science and Technology Shenzhen Research Institute（香港科技大学深圳研究院）
Image regression tasks for medical applications, such as bone mineral density (BMD) estimation and left-ventricular ejection fraction (LVEF) prediction, play an important role in computer-aided disease assessment. Most deep regression methods train the neural network with a single regression loss function like MSE or L1 loss. In this paper, we propose the first contrastive learning framework for deep image regression, namely AdaCon, which consists of a feature learning branch via a novel adaptive-margin contrastive loss and a regression prediction branch. Our method incorporates label distance…
LPIXEL Inc.（LPIXEL公司）；Saitama Prefectural University（埼玉县立大学）；Okayama City General Medical Center, Okayama City Hospital（冈山市综合医疗中心 冈山市立医院）；Okayama University（冈山大学）
Convolutional Neural Networks play a key role in bone age assessment for investigating endocrinology, genetic, and growth disorders under various modalities and body regions. However, no researcher has tackled bone age progression/regression despite its valuable potential applications: bone-related disease diagnosis, clinical knowledge acquisition, and museum education. Therefore, we propose Bone Age Progression Generative Adversarial Network (BAPGAN) to progress/regress both femur/phalange X-ray images while preserving identity and realism. We exhaustively confirm the BAPGAN's clinical potent…
University of Sheffield（谢菲尔德大学）；University of Leeds（利兹大学）；University of Oxford（牛津大学）；John Radcliffe Hospital（约翰·拉德克利夫医院）；Queen Mary University of London（伦敦玛丽女王大学）；Barts Health NHS Trust（巴特国民保健署信托基金会）
Cardiac magnetic resonance (CMR) images play a growing role in the diagnostic imaging of cardiovascular diseases. Full coverage of the left ventricle (LV), from base to apex, is a basic criterion for CMR image quality and necessary for accurate measurement of cardiac volume and functional assessment. Incomplete coverage of the LV is identified through visual inspection, which is time-consuming and usually done retrospectively in the assessment of large imaging cohorts. This paper proposes a novel automatic method for determining LV coverage from CMR images by using Fisher-discriminative three-…
It is common in anthropology and paleontology to address questions about extant and extinct species through the quantification of osteological features observable in micro-computed tomographic (micro-CT) scans. In cases where remains were buried, the grey values present in these scans may be classified as belonging to air, dirt, or bone. While various intensity-based methods have been proposed to segment scans into these classes, it is often the case that intensity values for dirt and bone are nearly indistinguishable. In these instances, scientists resort to laborious manual segmentation, whi…
This study applies a technique to expand the number of images to a level that allows deep learning. And the applicability of the Sauvegrain method through deep learning with relatively few elbow X-rays is studied. The study was composed of processes similar to the physicians' bone age assessment procedures. The selected reference images were learned without being included in the evaluation data, and at the same time, the data was extended to accommodate the number of cases. In addition, we adjusted the X-ray images to better images using U-Net and selected the ROI with RPN + so as to be able t…
Continual Action Assessment via Task-Consistent Score-Discriminative Feature Distribution Modeling
School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院）；School of Artificial Intelligence, Sun Yat-sen University（中山大学人工智能学院）
Validation of musculoskeletal segmentation model with uncertainty estimation for bone and muscle assessment in hip-to-knee clinical CT images
Nara Institute of Science and Technology（奈良先端科学技术大学院大学）；Osaka University（大阪大学）；Keio University School of Medicine（庆应义塾大学医学部）；Hitachi Ltd.（日立制作所）；Ehime University（爱媛大学）
Johns Hopkins University（约翰斯·霍普金斯大学）；Johns Hopkins Medical Institutes（约翰斯·霍普金斯医学院）；Konkuk University Medical Center（建国大学医疗中心）；Konkuk University School of Medicine（建国大学医学院）
Quantitative bone single-photon emission computed tomography (QBSPECT) has the potential to provide a better quantitative assessment of bone metastasis than planar bone scintigraphy due to its ability to better quantify activity in overlapping structures. An important element of assessing response of bone metastasis is accurate image segmentation. However, limited by the properties of QBSPECT images, the segmentation of anatomical regions-of-interests (ROIs) still relies heavily on the manual delineation by experts. This work proposes a fast and robust automated segmentation method for partiti…
Department of Biomedical Engineering, University of Basel（巴塞尔大学生物医学工程系）；Department of Biomedicine, Musculoskeletal Research, University of Basel（巴塞尔大学生物医学系肌肉骨骼研究部）；University of Basel（巴塞尔大学）
Segmentation of distinct bones plays a crucial role in diagnosis, planning, navigation, and the assessment of bone metastasis. It supplies semantic knowledge to visualisation tools for the planning of surgical interventions and the education of health professionals. Fully supervised segmentation of 3D data using Deep Learning methods has been extensively studied for many tasks but is usually restricted to distinguishing only a handful of classes. With 125 distinct bones, our case includes many more labels than typical 3D segmentation tasks. For this reason, the direct adaptation of most establ…
Deep Learning with Self-Attention and Enhanced Preprocessing for Precise Diagnosis of Acute Lymphoblastic Leukemia from Bone Marrow Smears in Hemato-Oncology
organization= Department of Mechatronics Engineering , addressline= Rajshahi University of Engineering \& Technology , city= Rajshahi , country= Bangladesh
Multiple Myeloma Lesion Segmentation on Whole-Body Diffusion-Weighted Imaging via Efficient Anatomical Anticipation and Multimodal Confirmation
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所多模态人工智能系统全国重点实验室）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Department of Radiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College（中国医学科学院北京协和医学院北京协和医院放射科）
Simulating Sinogram-Domain Motion and Correcting Image-Domain Artifacts Using Deep Learning in HR-pQCT Bone Imaging
Weldon School of Biomedical Engineering, Purdue University（沃伦生物医学工程学院，普渡大学）；Department of Radiology and Imaging Sciences, Indiana University School of Medicine（放射学与影像科学系，印第安纳大学医学院）；Department of Physical Therapy, School of Health & Human Sciences, Indiana University Indianapolis（物理治疗系，健康与人类科学学院，印第安纳大学印第安纳波利斯分校）
Bridging Classification and Segmentation in Osteosarcoma Assessment via Foundation and Discrete Diffusion Models
Hanoi University of Science and Technology（河内科学技术大学）；Vinmec Times City International Hospital（Vinmec Times City国际医院）；Vinmec Healthcare System（Vinmec医疗系统）；VinUni-Illinois Smart Health Center（VinUni-伊利诺伊智能健康中心）；College of Health Sciences, VinUniversity（VinUniversity健康科学学院）
Transformer-Based Multi-Region Segmentation and Radiomic Analysis of HR-pQCT Imaging for Osteoporosis Classification
Weldon School of Biomedical Engineering, Purdue University（普渡大学生物医学工程学院）；Division of Bone and Mineral Diseases, Washington University Medicine（华盛顿大学医学院骨科与矿物质疾病部）；Department of Anatomy, Cell Biology & Physiology, Indiana University School of Medicine（印第安纳大学医学院解剖学、细胞生物学与生理学部）；Department of Physical Therapy, School of Health & Human Sciences, Indiana University Indianapolis（印第安纳大学印第安纳波利斯分校物理治疗系）
University College London（伦敦大学学院）；University of Ibadan（伊巴丹大学）；University College Hospital（大学学院医院）；Great Ormond Street Hospital for Children（大奥蒙德街儿童医院）
While optical microscopy inspection of blood films and bone marrow aspirates by a hematologist is a crucial step in establishing diagnosis of acute leukemia, especially in low-resource settings where other diagnostic modalities might not be available, the task remains time-consuming and prone to human inconsistencies. This has an impact especially in cases of Acute Promyelocytic Leukemia (APL) that require urgent treatment. Integration of automated computational hematopathology into clinical workflows can improve the throughput of these services and reduce cognitive human error. However, a maj…
University of Rochester（罗切斯特大学）；Edmund A. Hajim School of Engineering and Applied Sciences（埃德蒙·A·哈吉姆工程与应用科学学院）
Bone fragility and fracture caused by osteoporosis or injury are prevalent in adults over the age of 50 and can reduce their quality of life. Hence, predicting the biomechanical bone strength, specifically of the proximal femur, through non-invasive imaging-based methods is an important goal for the diagnosis of Osteoporosis as well as estimating fracture risk. Dual X-ray absorptiometry (DXA) has been used as a standard clinical procedure for assessment and diagnosis of bone strength and osteoporosis through bone mineral density (BMD) measurements. However, previous studies have shown that qua…
Florida International University（佛罗里达国际大学）；Technical University of Munich（慕尼黑工业大学）；Stanford University（斯坦福大学）
Chest X-ray radiography is one of the earliest medical imaging technologies and remains one of the most widely-used for diagnosis, screening, and treatment follow up of diseases related to lungs and heart. The literature in this field of research reports many interesting studies dealing with the challenging tasks of bone suppression and organ segmentation but performed separately, limiting any learning that comes with the consolidation of parameters that could optimize both processes. This study, and for the first time, introduces a multitask deep learning model that generates simultaneously t…
We propose an automated method for detecting aggressive prostate cancer(CaP) (Gleason score >=7) based on a comprehensive analysis of the lesion and the surrounding normal prostate tissue which has been simultaneously captured in T2-weighted MR images, diffusion-weighted images (DWI) and apparent diffusion coefficient maps (ADC). The proposed methodology was tested on a dataset of 79 patients (40 aggressive, 39 non-aggressive). We evaluated the performance of a wide range of popular quantitative imaging features on the characterization of aggressive versus non-aggressive CaP. We found that a g…
Athlete performance measurement in sports videos requires modeling long sequences since the entire spatio-temporal progression contributes dominantly to the performance. It is crucial to comprehend local discriminative spatial dependencies and global semantics for accurate evaluation. However, existing benchmark datasets mainly incorporate sports where the performance lasts only a few seconds. Consequently, state-ofthe-art sports quality assessment methods specifically focus on spatial structure. Although they achieve high performance in short-term sports, they are unable to model prolonged vi…
Radboud University Medical Center（拉德堡德大学医学中心）；Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）；Harvard Medical School（哈佛医学院）；National Cancer Institute（美国国家癌症研究所）；The Harker School（哈克学校）；Mayo Clinic（梅奥诊所）
Diagnosis of breast carcinomas has so far been limited to the morphological interpretation of epithelial cells and the assessment of epithelial tissue architecture. Consequently, most of the automated systems have focused on characterizing the epithelial regions of the breast to detect cancer. In this paper, we propose a system for classification of hematoxylin and eosin (H&E) stained breast specimens based on convolutional neural networks that primarily targets the assessment of tumor-associated stroma to diagnose breast cancer patients. We evaluate the performance of our proposed system usin…
Universityhospital Tübingen（图宾根大学医院）；University Hospital of Padua（帕多瓦大学医院）；Hopital Universitaire Henri Mondor（亨利·蒙多大学医院）；University of Genoa（热那亚大学）；University of Tübingen（图宾根大学）
To meet the current need for skeletal tumor-load estimation in prostate cancer (mCRPC), we developed a novel approach, based on adaptive bone segmentation. In this study, we compared the program output with existing estimates and with the radiological outcome. Seventy-six whole-body 99mTc-DPD-SPECT/CT from mCRPC patients were analyzed. The software identified the whole skeletal volume (SVol) and classified it voxels metastases (MVol) or normal bone (BVol). SVol was compared with the estimation of a commercial software. MVol was compared with manual assessment and with PSA-level. Counts/voxel w…
Structure-aware Knowledge-guided Heterogeneous Mamba for Zygomaticomaxillary Suture Assessment
College of Computer Science and Software Engineering, Shenzhen University（深圳大学计算机与软件学院）；School of Artificial Intelligence, Shenzhen University（深圳大学人工智能学院）；Affiliated Stomatology Hospital of Kunming Medical University（昆明医科大学附属口腔医院）；Shenzhen University General Hospital（深圳大学总医院）
Sun Yat-sen University（中山大学）；Zhejiang Laboratory（之江实验室）；Peking University（北京大学）；PengCheng Laboratory（鹏城实验室）
The objective of action quality assessment is to score sports videos. However, most existing works focus only on video dynamic information (i.e., motion information) but ignore the specific postures that an athlete is performing in a video, which is important for action assessment in long videos. In this work, we present a novel hybrid dynAmic-static Context-aware attenTION NETwork (ACTION-NET) for action assessment in long videos. To learn more discriminative representations for videos, we not only learn the video dynamic information but also focus on the static postures of the detected athle…
Contrastive Local Manifold Learning for No-Reference Image Quality Assessment
School of Information and Electronics, Beijing Institute of Technology（信息与电子学院，北京理工大学）；School of Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Xiamen University（多媒体可信感知与高效计算学院，厦门大学）；YouTu Laboratory, Tencent Company（YouTu实验室，腾讯公司）
City University of Hong Kong（香港城市大学）；University of Missouri-Kansas City（密苏里大学堪萨斯城分校）
In this paper, we propose a no-reference (NR) image quality assessment (IQA) method via feature level pseudo-reference (PR) hallucination. The proposed quality assessment framework is grounded on the prior models of natural image statistical behaviors and rooted in the view that the perceptually meaningful features could be well exploited to characterize the visual quality. Herein, the PR features from the distorted images are learned by a mutual learning scheme with the pristine reference as the supervision, and the discriminative characteristics of PR features are further ensured with the tr…
