This paper presents a safety-centered empirical evaluation of uncertainty-aware last-layer adaptation for referable diabetic retinopathy screening using RETFound, a self-supervised vision-transformer retinal foundation model used here as a frozen feature encoder, and the public APTOS 2019 and DDR diabetic retinopathy fundus image datasets. We compare a cached-feature softmax head, post-hoc temperature scaling, variational Bayesian last-layer heads, a diagonal Laplace last-layer approximation, and an SNGP-style cached-feature head. On APTOS, uncertainty-aware operating points improved sensitivity and selective-referral behavior. The strongest APTOS selective-referral result deferred approximately 20 percent of cases and reduced accepted-case false negatives to zero while preserving high accepted-case specificity. However, threshold tuning also reduced false negatives at high false-positive cost, so false-negative reduction alone was not unique to Bayesian modeling. On DDR, native Bayesian heads qualitatively reproduced the APTOS direction but with weaker tradeoffs, while the APTOS-trained SNGP checkpoint transferred poorly and failed to provide useful external selective-referral behavior. These results highlight the value of safety-centered evaluation beyond aggregate accuracy: uncertainty-aware last-layer heads can improve internal safety-oriented operating points, but trustworthy retinal screening claims require explicit safety-coverage evaluation and second-dataset validation under shift.
Ramón y Cajal University Hospital(拉蒙·卡哈尔大学医院);Ramón y Cajal Health Research Institute (IRYCIS)(拉蒙·卡哈尔健康研究所(IRYCIS));University of Alcalá de Henares(阿尔卡拉·德·埃纳雷斯大学);Thirona(Thirona公司)
Background: To determine the ability of a commercially available deep learning system, RetCAD v.1.3.1 (Thirona, Nijmegen, The Netherlands) for the automatic detection of referable diabetic retinopathy (DR) on a dataset of colour fundus images acquired during routine clinical practice in a tertiary hospital screening program, analyzing the reduction of workload that can be released incorporating this artificial intelligence-based technology. Methods: Evaluation of the software was performed on a dataset of 7195 nonmydriatic fundus images from 6325 eyes of 3189 diabetic patients attending our sc…
Deep learning-based models are developed to automatically detect if a retina image is `referable' in diabetic retinopathy (DR) screening. However, their classification accuracy degrades as the input images distributionally shift from their training distribution. Further, even if the input is not a retina image, a standard DR classifier produces a high confident prediction that the image is `referable'. Our paper presents a Dirichlet Prior Network-based framework to address this issue. It utilizes an out-of-distribution (OOD) detector model and a DR classification model to improve generalizabil…
Department of Computer Science, Aalto University(阿尔托大学计算机科学系);The Alan Turing Institute(艾伦图灵研究所);University of Warwick(华威大学);University College London(伦敦大学学院);Department of Electrical Engineering and Automation, Aalto University(阿尔托大学电气工程与自动化系);Central Finland Health Care District(芬兰中部医疗保健区)
Automatic classification of diabetic retinopathy from retinal images has been widely studied using deep neural networks with impressive results. However, there is a clinical need for estimation of the uncertainty in the classifications, a shortcoming of modern neural networks. Recently, approximate Bayesian deep learning methods have been proposed for the task but the studies have only considered the binary referable/non-referable diabetic retinopathy classification applied to benchmark datasets. We present novel results by systematically investigating a clinical dataset and a clinically relev…
Aristotle University of Thessaloniki(塞萨洛尼基亚里士多德大学)
Diabetic Retinopathy (DR) is a leading cause of vision loss globally. Yet despite its prevalence, the majority of affected people lack access to the specialized ophthalmologists and equipment required for assessing their condition. This can lead to delays in the start of treatment, thereby lowering their chances for a successful outcome. Machine learning systems that automatically detect the disease in eye fundus images have been proposed as a means of facilitating access to DR severity estimates for patients in remote regions or even for complementing the human expert's diagnosis. In this pap…
Radboud University Medical Center(拉德堡德大学医学中心);Donders Institute for Brain, Cognition and Behaviour(唐德斯脑、认知与行为研究所);University Hospital Ramón y Cajal(拉蒙·卡哈尔大学医院);Ramón y Cajal Health Research Institute (IRYCIS)(拉蒙·卡哈尔健康研究所(IRYCIS));Clínica Rementería(雷门特利亚诊所)
Purpose: To validate the performance of a commercially-available, CE-certified deep learning (DL) system, RetCAD v.1.3.0 (Thirona, Nijmegen, The Netherlands), for the joint automatic detection of diabetic retinopathy (DR) and age-related macular degeneration (AMD) in color fundus (CF) images on a dataset with mixed presence of eye diseases. Methods: Evaluation of joint detection of referable DR and AMD was performed on a DR-AMD dataset with 600 images acquired during routine clinical practice, containing referable and non-referable cases of both diseases. Each image was graded for DR and AMD b…
PLADEMA Institute, UNICEN(国立中央布宜诺斯艾利斯省大学PLADEMA研究所);Centro de Oftalmología Martínez(马丁内斯眼科中心)
Deep learning is currently the state-of-the-art for automated detection of referable diabetic retinopathy (DR) from color fundus photographs (CFP). While the general interest is put on improving results through methodological innovations, it is not clear how good these approaches perform compared to standard deep classification models trained with the appropriate settings. In this paper we propose to model a strong baseline for this task based on a simple and standard ResNet-18 architecture. To this end, we built on top of prior art by training the model with a standard preprocessing strategy …
Arizona State University(亚利桑那州立大学);Washington University in St. Louis(圣路易斯华盛顿大学);Children’s Hospital Los Angeles(洛杉矶儿童医院);Mayo Clinic(梅奥诊所)
Lesion appearance is a crucial clue for medical providers to distinguish referable diabetic retinopathy (rDR) from non-referable DR. Most existing large-scale DR datasets contain only image-level labels rather than pixel-based annotations. This motivates us to develop algorithms to classify rDR and segment lesions via image-level labels. This paper leverages self-supervised equivariant learning and attention-based multi-instance learning (MIL) to tackle this problem. MIL is an effective strategy to differentiate positive and negative instances, helping us discard background regions (negative i…
Cross Feature Fusion of Fundus Image and Generated Lesion Map for Referable Diabetic Retinopathy Classification
Sungkyunkwan University(成均馆大学);College of Computing and Informatics, Sungkyunkwan University(成均馆大学计算与信息学院);Dept. of Electrical and Computer Engineering, Sungkyunkwan University(成均馆大学电气与计算机工程系)
Visulytix Ltd(维视利泰有限公司);Instituto Mexicano de Oftalmología(墨西哥眼科研究所);Instituto de la Retina del Bajío(巴希奥视网膜研究所);Mater Dei Hospital(圣母医院);King’s College Hospital NHS Foundation Trust(国王学院医院国民保健信托基金)
Objectives: To evaluate the performance of an Artificial Intelligence (AI) system (Pegasus, Visulytix Ltd., UK), at the detection of Diabetic Retinopathy (DR) from images captured by a handheld portable fundus camera. Methods: A cohort of 6,404 patients (~80% with diabetes mellitus) was screened for retinal diseases using a handheld portable fundus camera (Pictor Plus, Volk Optical Inc., USA) at the Mexican Advanced Imaging Laboratory for Ocular Research. The images were graded for DR by specialists according to the Scottish DR grading scheme. The performance of the AI system was evaluated, re…
Casey Eye Institute, Oregon Health & Science University(俄勒冈健康与科学大学凯西眼科研究所);Department of Biomedical Engineering, Oregon Health & Science University(俄勒冈健康与科学大学生物医学工程系)
Objective: Optical coherence tomography (OCT) and its angiography (OCTA) have several advantages for the early detection and diagnosis of diabetic retinopathy (DR). However, automated, complete DR classification frameworks based on both OCT and OCTA data have not been proposed. In this study, a convolutional neural network (CNN) based method is proposed to fulfill a DR classification framework using en face OCT and OCTA. Methods: A densely and continuously connected neural network with adaptive rate dropout (DcardNet) is designed for the DR classification. In addition, adaptive label smoothing…
Rajavithi Hospital(拉贾维蒂医院);Google AI(谷歌人工智能);Google(谷歌);Sankara Nethralaya(尚卡拉·内特拉拉亚医院);Vajira Hospital(瓦吉拉医院);Eye and Laser Center(眼科与激光中心);East Bay Retina Consultants(东湾视网膜顾问诊所);University of California San Francisco(加州大学旧金山分校);Retina-Vitreous Associates Medical Group(视网膜玻璃体联合医疗集团);University of Southern California(南加州大学);Lamphun Hospital(南奔医院);Somdejphrajaotaksin Maharaj Hospital(颂德帕昭达信玛哈拉医院);Sawanpracharak Hospital(沙旺帕乍拉医院);Nakhon Nayok Hospital(那空那育医院);Photharam Hospital(波塔兰医院);Prapokklao Hospital(巴博告医院);Mahasarakham Hospital(马哈沙拉堪医院);Nongbualamphu Hospital(廊磨喃蒲医院);Pakchongnana Hospital(北冲纳纳医院);Mukdahan Hospital(穆达汉医院);Suratthani Hospital(素叻他尼医院);Sungaikolok Hospital(双溪哥乐医院);Bangkok Metropolitan Administration Public Health Center 7(曼谷市行政公署第七公共卫生中心)
Deep learning algorithms have been used to detect diabetic retinopathy (DR) with specialist-level accuracy. This study aims to validate one such algorithm on a large-scale clinical population, and compare the algorithm performance with that of human graders. 25,326 gradable retinal images of patients with diabetes from the community-based, nation-wide screening program of DR in Thailand were analyzed for DR severity and referable diabetic macular edema (DME). Grades adjudicated by a panel of international retinal specialists served as the reference standard. Across different severity levels of…
Aalto University School of Science(阿尔托大学理学院);Digifundus Ltd.(Digifundus有限公司);Central Finland Central Hospital(中芬兰中心医院)
Diabetes is a globally prevalent disease that can cause visible microvascular complications such as diabetic retinopathy and macular edema in the human eye retina, the images of which are today used for manual disease screening. This labor-intensive task could greatly benefit from automatic detection using deep learning technique. Here we present a deep learning system that identifies referable diabetic retinopathy comparably or better than presented in the previous studies, although we use only a small fraction of images (<1/4) in training but are aided with higher image resolutions. We also …
Deep learning is quickly becoming the leading methodology for medical image analysis. Given a large medical archive, where each image is associated with a diagnosis, efficient pathology detectors or classifiers can be trained with virtually no expert knowledge about the target pathologies. However, deep learning algorithms, including the popular ConvNets, are black boxes: little is known about the local patterns analyzed by ConvNets to make a decision at the image level. A solution is proposed in this paper to create heatmaps showing which pixels in images play a role in the image-level predic…
Exploring Deep Learning and Ultra-Widefield Imaging for Diabetic Retinopathy and Macular Edema
BiometricsAI, Universidad Autónoma de Madrid, Madrid, Spain(生物度量AI,马德里自治大学,马德里,西班牙);Department of Mathematics, Universidad de Las Palmas de Gran Canaria, Spain(数学系,拉斯帕尔马斯大Canaria大学,西班牙);HCTLab Research Group, Universidad Autónoma de Madrid, Madrid, Spain(HCTLab研究组,马德里自治大学,马德里,西班牙)
Dual-Resolution Attention-Gated Deep Learning with Ordinal Regression for Diabetic Retinopathy Grading: A Quantified Assessment of Cross-Domain Generalization
Tuwaiq Academy(图瓦伊克学院);Tuwaiq Research and Development Centre(图瓦伊克研究与发展中心)
Model Confidence-Guided Multi-Image Fusion of Fundus Images for Diabetic Retinopathy Diagnosis
Massachusetts Institute of Technology(麻省理工学院);Wilmer Eye Institute, Department of Ophthalmology, Johns Hopkins University(约翰霍普金斯大学威尔默眼科研究所);Department of Biomedical Engineering, Johns Hopkins University(约翰霍普金斯大学生物医学工程系);Bakar Computational Health Sciences Institute, University of California San Francisco(加州大学旧金山分校巴卡计算健康科学研究所);Department of Ophthalmology, University of California San Francisco(加州大学旧金山分校眼科系);Division of Clinical Informatics and Digital Transformation, University of California San Francisco(加州大学旧金山分校临床信息学与数字化转型 division)