GlanceSeg: Real-time microaneurysm lesion segmentation with gaze-map-guided foundation model for early detection of diabetic retinopathy
Southern University of Science and Technology（南方科技大学）；Wenzhou Medical University（温州医科大学）；Intelligent Vision Plus Technology Co., Ltd.（深圳市智能视觉加科技有限公司）；The Chinese University of Hong Kong（香港中文大学）
Early-stage diabetic retinopathy (DR) presents challenges in clinical diagnosis due to inconspicuous and minute microangioma lesions, resulting in limited research in this area. Additionally, the potential of emerging foundation models, such as the segment anything model (SAM), in medical scenarios remains rarely explored. In this work, we propose a human-in-the-loop, label-free early DR diagnosis framework called GlanceSeg, based on SAM. GlanceSeg enables real-time segmentation of microangioma lesions as ophthalmologists review fundus images. Our human-in-the-loop framework integrates the ophthalmologist's gaze map, allowing for rough localization of minute lesions in fundus images. Subsequently, a saliency map is generated based on the located region of interest, which provides prompt points to assist the foundation model in efficiently segmenting microangioma lesions. Finally, a domain knowledge filter refines the segmentation of minute lesions. We conducted experiments on two newly-built public datasets, i.e., IDRiD and Retinal-Lesions, and validated the feasibility and superiority of GlanceSeg through visualized illustrations and quantitative measures. Additionally, we demonstrated that GlanceSeg improves annotation efficiency for clinicians and enhances segmentation performance through fine-tuning using annotations. This study highlights the potential of GlanceSeg-based annotations for self-model optimization, leading to enduring performance advancements through continual learning.
Eindhoven University of Technology（埃因霍温理工大学）；Northeastern University（东北大学）
Retinal microaneurysms are the earliest clinical sign of diabetic retinopathy disease. Detection of microaneurysms is crucial for the early diagnosis of diabetic retinopathy and prevention of blindness. In this paper, a novel and reliable method for automatic detection of microaneurysms in retinal images is proposed. In the first stage of the proposed method, several preliminary microaneurysm candidates are extracted using a gradient weighting technique and an iterative thresholding approach. In the next stage, in addition to intensity and shape descriptors, a new set of features based on loca…
TJDR: A High-Quality Diabetic Retinopathy Pixel-Level Annotation Dataset
Tongji University（同济大学）；Tongji Hospital, School of Medicine, Tongji University（同济大学附属同济医院）；Tongji Eye Institute, School of Medicine, Tongji University（同济大学医学院同济眼科研究所）
Technical University of Munich（慕尼黑工业大学）；Carl Zeiss Meditec AG（卡尔蔡司医疗技术股份公司）；Johns Hopkins University（约翰斯·霍普金斯大学）
Deep learning techniques are recently being used in fundus image analysis and diabetic retinopathy detection. Microaneurysms are an important indicator of diabetic retinopathy progression. We introduce a two-stage deep learning approach for microaneurysms segmentation using multiple scales of the input with selective sampling and embedding triplet loss. The model first segments on two scales and then the segmentations are refined with a classification model. To enhance the discriminative power of the classification model, we incorporate triplet embedding loss with a selective sampling routine.…
Early detection of microaneurysms (MAs), the first sign of Diabetic Retinopathy (DR), is an essential first step in automated detection of DR to prevent vision loss and blindness. This study presents a novel and different algorithm for automatic detection of MAs in fluorescein angiography (FA) fundus images, based on Radon transform (RT) and multi-overlapping windows. This project addresses a novel method, in detection of retinal land marks and lesions to diagnose the DR. At the first step, optic nerve head (ONH) was detected and masked. In preprocessing stage, top-hat transformation and avera…
SRM Institute of Science and Technology（SRM科学技术研究所）
Diabetic Retinopathy (DR) is a severe complication that may lead to retinal vascular damage and is one of the leading causes of vision impairment and blindness. DR broadly is classified into two stages - non-proliferative (NPDR), where there are almost no symptoms, except a few microaneurysms, and proliferative (PDR) involving a huge number of microaneurysms and hemorrhages, soft and hard exudates, neo-vascularization, macular ischemia or a combination of these, making it easier to detect. More specifically, DR is usually classified into five levels, labeled 0-4, from 0 indicating no DR to 4 w…
University of Georgia（佐治亚大学）；Florida International University（佛罗里达国际大学）
DRDr II is a hybrid of machine learning and deep learning worlds. It builds on the successes of its antecedent, namely, DRDr, that was trained to detect, locate, and create segmentation masks for two types of lesions (exudates and microaneurysms) that can be found in the eyes of the Diabetic Retinopathy (DR) patients; and uses the entire model as a solid feature extractor in the core of its pipeline to detect the severity level of the DR cases. We employ a big dataset with over 35 thousand fundus images collected from around the globe and after 2 phases of preprocessing alongside feature extra…
Brown University（布朗大学）；Beetham Eye Institute, Joslin Diabetes Center（乔斯林糖尿病中心比瑟姆眼科研究所）；Harvard Medical School（哈佛医学院）
Microaneurysms (MAs) are one of the earliest signs of diabetic retinopathy (DR), a frequent complication of diabetes that can lead to visual impairment and blindness. Adaptive optics scanning laser ophthalmoscopy (AOSLO) provides real-time retinal images with resolution down to 2 $μm$ and thus allows detection of the morphologies of individual MAs, a potential marker that might dictate MA pathology and affect the progression of DR. In contrast to the numerous automatic models developed for assessing the number of MAs on fundus photographs, currently there is no high throughput image protocol a…
Diabetic Retinopathy (DR) is a leading cause of blindness in working age adults. DR lesions can be challenging to identify in fundus images, and automatic DR detection systems can offer strong clinical value. Of the publicly available labeled datasets for DR, the Indian Diabetic Retinopathy Image Dataset (IDRiD) presents retinal fundus images with pixel-level annotations of four distinct lesions: microaneurysms, hemorrhages, soft exudates and hard exudates. We utilize the HEDNet edge detector to solve a semantic segmentation task on this dataset, and then propose an end-to-end system for pixel…
Kasetsart University（泰国农业大学）；National Electronics and Computer Technology Centre（泰国国家电子与计算机技术中心）；Tokyo Institute of Technology（东京工业大学）
This research aims to develop an efficient system for screening of diabetic retinopathy. Diabetic retinopathy is the major cause of blindness. Severity of diabetic retinopathy is recognized by some features, such as blood vessel area, exudates, haemorrhages and microaneurysms. To grade the disease the screening system must efficiently detect these features. In this paper we are proposing a simple and fast method for detection of diabetic retinopathy. We do pre-processing of grey-scale image and find all labelled connected components (blobs) in an image regardless of whether it is haemorrhages,…
University of Isfahan（伊斯法罕大学）；Isfahan University of Medical Sciences（伊斯法罕医科大学）
Diabetic Retinopathy (DR) caused by diabetes occurs as a result of changes in the retinal vessels and causes visual impairment. Microaneurysms (MAs) are the early clinical signs of DR, whose timely diagnosis can help detecting DR in the early stages of its development. It has been observed that MAs are more common in the inner retinal layers compared to the outer retinal layers in eyes suffering from DR. Optical Coherence Tomography (OCT) is a noninvasive imaging technique that provides a cross-sectional view of the retina and it has been used in recent years to diagnose many eye diseases. As …
University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心）；Indiana University-Purdue University（印第安纳大学-普渡大学）
Diabetes Mellitus (DM) can lead to significant microvasculature disruptions that eventually causes diabetic retinopathy (DR), or complications in the eye due to diabetes. If left unchecked, this disease can increase over time and eventually cause complete vision loss. The general method to detect such optical developments is through examining the vessels, optic nerve head, microaneurysms, haemorrhage, exudates, etc. from retinal images. Ultimately this is limited by the number of experienced ophthalmologists and the vastly growing number of DM cases. To enable earlier and efficient DR diagnosi…
Institute of Systems Science, National University of Singapore（新加坡国立大学系统科学研究所）；University of Electronic Science and Technology of China（电子科技大学）；Wuhan University of Science and Technology（武汉科技大学）；Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System（湖北省智能信息处理与实时工业系统重点实验室）
Diabetic retinopathy (DR) is a common retinal disease that leads to blindness. For diagnosis purposes, DR image grading aims to provide automatic DR grade classification, which is not addressed in conventional research methods of binary DR image classification. Small objects in the eye images, like lesions and microaneurysms, are essential to DR grading in medical imaging, but they could easily be influenced by other objects. To address these challenges, we propose a new deep learning architecture, called BiRA-Net, which combines the attention model for feature extraction and bilinear model fo…
Imaging methods by using computer techniques provide doctors assistance at any time and relieve their workload, especially for iterative processes like identifying objects of interest such as lesions and anatomical structures from the image. Detection of microaneurysms (MAs) as one of the lesions in the retina is considered to be a crucial step in some retinal image analysis algorithms for the identification of diabetic retinopathy (DR) as the second-largest eye diseases in developed countries. The objective of this study is to compare the effect of two preprocessing methods, Illumination Equa…
Detection and Classification of Diabetic Retinopathy using Deep Learning Algorithms for Segmentation to Facilitate Referral Recommendation for Test and Treatment Prediction
Image processing techniques provide important assistance to physicians and relieve their workload in different tasks. In particular, identifying objects of interest such as lesions and anatomical structures from the image is a challenging and iterative process that can be done by computerized approaches in a successful manner. Microaneurysms (MAs) detection is a crucial step in retinal image analysis algorithms. The goal of MAs detection is to find the progress and at last identification of diabetic retinopathy (DR) in the retinal images. The objective of this study is to apply three retinal v…
Computer-Aided Diagnosis systems are required to extract suitable information about retina and its changes. In particular, identifying objects of interest such as lesions and anatomical structures from the retinal images is a challenging and iterative process that is doable by image processing approaches. Microaneurysm (MAs) are one set of these changes caused by diabetic retinopathy (DR). In fact, MAs detection is the main step for the identification of DR in the retinal images analysis. The objective of this study is to apply an automated method for the detection of MAs and compare the resul…
FQPDR: Federated Quantum Neural Network for Privacy-preserving Early Detection of Diabetic Retinopathy
Department of Computer Science and Engineering, Maulana Abul Kalam Azad University of Technology, West Bengal（计算机科学与工程系，穆拉纳·阿布·卡尔·拉马纳特技术大学，西孟加拉邦）；Department of Computer Science and Engineering, MCKV Institute of Engineering, West Bengal（计算机科学与工程系，MCKV工程学院，西孟加拉邦）；Department of Computer Science and Engineering, OmDayal Group of Institutions, West Bengal（计算机科学与工程系，OmDayal学院集团，西孟加拉邦）
DRetNet: A Novel Deep Learning Framework for Diabetic Retinopathy Diagnosis
Nantong Hamadun Medical Technology Co., Ltd（南通哈马顿医疗科技有限公司）；Department of Ophthalmology, The Affiliated Hospital of Guilin Medical University（桂林医学院附属医院眼科）
A Deep Learning-Based Unified Framework for Red Lesions Detection on Retinal Fundus Images
Computer and Information Science College, King Saud University（沙特王后大学计算机与信息科学学院）；Department of Ophthalmology, College of Medicine, Princess Nourah bint Abdulrahman University（普里丝特努尔·阿卜杜勒拉赫曼大学医学院眼科系）
