超广角光学相干断层扫描血管成像(UW-OCTA)是一种新兴的成像技术,通过提供高达24 x 20 $mm^{2}$的超宽扫描范围,覆盖视网膜前部和后部区域,相较于传统OCTA具有显著优势。然而,目前可获取的UW-OCTA数据集存在全面的分层信息及相应疾病标注有限的问题。为解决这一局限,我们构建了开创性的M3OCTA数据集,这是首个多模态(即多层)、多疾病且视野最宽的UW-OCTA数据集。此外,有效利用UW-OCTA的多层超广角眼部血管信息仍未被充分开发。为应对这一挑战,我们提出了首个跨模态融合框架,利用多模态信息诊断多种疾病。通过在我们公开可用的M3OCTA数据集上进行的大量实验,我们证明了该方法在固定和变化模态设置下的有效性和优越性能。M3OCTA数据集作为首个涵盖多种疾病的多模态OCTA数据集的构建,旨在推动眼科图像分析社区的研究进展。
英文摘要:
Ultra-wide optical coherence tomography angiography (UW-OCTA) is an emerging imaging technique that offers significant advantages over traditional OCTA by providing an exceptionally wide scanning range of up to 24 x 20 $mm^{2}$, covering both the anterior and posterior regions of the retina. However, the currently accessible UW-OCTA datasets suffer from limited comprehensive hierarchical information and corresponding disease annotations. To address this limitation, we have curated the pioneering M3OCTA dataset, which is the first multimodal (i.e., multilayer), multi-disease, and widest field-of-view UW-OCTA dataset. Furthermore, the effective utilization of multi-layer ultra-wide ocular vasculature information from UW-OCTA remains underdeveloped. To tackle this challenge, we propose the first cross-modal fusion framework that leverages multi-modal information for diagnosing multiple diseases. Through extensive experiments conducted on our openly available M3OCTA dataset, we demonstrate the effectiveness and superior performance of our method, both in fixed and varying modalities settings. The construction of the M3OCTA dataset, the first multimodal OCTA dataset encompassing multiple diseases, aims to advance research in the ophthalmic image analysis community.
OMSN and FAROS: OCTA Microstructure Segmentation Network and Fully Annotated Retinal OCTA Segmentation Dataset
State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University(中山大学中山眼科中心眼科学国家重点实验室);Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science(广东省眼科与视觉科学重点实验室)
Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所);the Second Affiliated Hospital of Zhejiang University(浙江大学医学院附属第二医院);Ningbo First Hospital(宁波市第一医院);Edge Hill University(边山大学);Ningbo University of Technology(宁波工程学院)
Automated detection of retinal structures, such as retinal vessels (RV), the foveal avascular zone (FAZ), and retinal vascular junctions (RVJ), are of great importance for understanding diseases of the eye and clinical decision-making. In this paper, we propose a novel Voting-based Adaptive Feature Fusion multi-task network (VAFF-Net) for joint segmentation, detection, and classification of RV, FAZ, and RVJ in optical coherence tomography angiography (OCTA). A task-specific voting gate module is proposed to adaptively extract and fuse different features for specific tasks at two levels: featur…
Nanjing University of Science and Technology(南京理工大学);The First Affiliated Hospital with Nanjing Medical University(南京医科大学第一附属医院)
Optical coherence tomography angiography (OCTA) is a novel non-invasive imaging modality that allows micron-level resolution to visualize the retinal microvasculature. The retinal vessel segmentation in OCTA images is still an open problem, and especially the thin and dense structure of the capillary plexus is an important challenge of this problem. In this work, we propose a novel image magnification network (IMN) for vessel segmentation in OCTA images. Contrary to the U-Net structure with a down-sampling encoder and up-sampling decoder, the proposed IMN adopts the design of up-sampling encod…
Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations
Technical University of Munich(慕尼黑工业大学);Imperial College London(帝国理工学院);Helmholtz Zentrum Muenchen(亥姆霍兹慕尼黑中心);University of Innsbruck(因斯布鲁克大学);University of Oxford(牛津大学);Moorfields Eye Hospital NHS Foundation Trust(摩尔菲尔德眼科医院国民保健服务基金会信托);Boehringer Ingelheim Limited(勃林格殷格翰有限公司);University College London(伦敦大学学院);Cairo University(开罗大学);Watany Eye Hospital(瓦塔尼眼科医院);Heidelberg Engineering GmbH(海德堡工程有限公司);University of Zurich(苏黎世大学)
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Henan University of Chinese Medicine(河南中医药大学)
3D to 2D retinal vessel segmentation is a challenging problem in Optical Coherence Tomography Angiography (OCTA) images. Accurate retinal vessel segmentation is important for the diagnosis and prevention of ophthalmic diseases. However, making full use of the 3D data of OCTA volumes is a vital factor for obtaining satisfactory segmentation results. In this paper, we propose a Progressive Attention-Enhanced Network (PAENet) based on attention mechanisms to extract rich feature representation. Specifically, the framework consists of two main parts, the three-dimensional feature learning path and…
The accurate retinal vessel segmentation (RVS) is of great significance to assist doctors in the diagnosis of ophthalmology diseases and other systemic diseases. Manually designing a valid neural network architecture for retinal vessel segmentation requires high expertise and a large workload. In order to improve the performance of vessel segmentation and reduce the workload of manually designing neural network, we propose novel approach which applies neural architecture search (NAS) to optimize an encoder-decoder architecture for retinal vessel segmentation. A modified evolutionary algorithm …
Polar-Net: A Clinical-Friendly Model for Alzheimer's Disease Detection in OCTA Images
Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所);Cixi Biomedical Research Institute, Wenzhou Medical University(温州医科大学慈溪生物医学研究院);School of Future Technology, South China University of Technology(华南理工大学未来技术学院);Institute of High-Performance Computing, Agency for Science, Technology and Research(新加坡科技研究局高性能计算研究所);Department of Computer Science, Southern University of Science and Technology(南方科技大学计算机科学与工程系);Department of Eye and Vision Science, University of Liverpool(利物浦大学眼与视觉科学系);Department of Computer Science, Edge Hill University(埃奇希尔大学计算机科学系);Pazhou Lab(琶洲实验室)
BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Images
University of Electronic Science and Technology of China(电子科技大学);Southern Methodist University(南方法律大学);University of Texas Southwestern Medical Center(德克萨斯西南医学中心);University Medical Center Utrecht(乌得勒支大学医学中心);Georgetown University(杰斐逊大学);Sichuan Provincial People’s Hospital(四川省级人民医院);University of Connecticut(康涅狄格大学)
Centro de Investigación CITIC(CITIC研究中心);Universidade da Coruña(拉科鲁尼亚大学);Instituto de Investigación Biomédica de A Coruña (INIBIC)(拉科鲁尼亚生物医学研究所(INIBIC));Hospital Clínico San Carlos(圣卡洛斯临床医院);Instituto de Investigación Sanitaria (IdISSC)(健康研究所(IdISSC));Centro Internacional de Oftalmología Avanzada(国际高级眼科中心)
Age-related Macular Degeneration (AMD) is the predominant cause of blindness in developed countries, specially in elderly people. Moreover, its prevalence is increasing due to the global population ageing. In this scenario, early detection is crucial to avert later vision impairment. Nonetheless, implementing large-scale screening programmes is usually not viable, since the population at-risk is large and the analysis must be performed by expert clinicians. Also, the diagnosis of AMD is considered to be particularly difficult, as it is characterized by many different lesions that, in many case…
King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Georgia Institute of Technology(佐治亚理工学院);University of Waterloo(滑铁卢大学);Bern University Hospital(伯尔尼大学医院);Tri-Service General Hospital(三军总医院);National Taiwan University(台湾大学)
Automatic clinical diagnosis of retinal diseases has emerged as a promising approach to facilitate discovery in areas with limited access to specialists. Based on the fact that fundus structure and vascular disorders are the main characteristics of retinal diseases, we propose a novel visual-assisted diagnosis hybrid model mixing the support vector machine (SVM) and deep neural networks (DNNs). Furthermore, we present a new clinical retina dataset, called EyeNet2, for ophthalmology incorporating 52 retina diseases classes. Using EyeNet2, our model achieves 90.43\% diagnosis accuracy, and the m…
Early diagnosis of retinal diseases such as diabetic retinopathy has had the attention of many researchers. Deep learning through the introduction of convolutional neural networks has become a prominent solution for image-related tasks such as classification and segmentation. Most tasks in image classification are handled by deep CNNs pretrained and evaluated on imagenet dataset. However, these models do not always translate to the best result on other datasets. Devising a neural network manually from scratch based on heuristics may not lead to an optimal model as there are numerous hyperparam…
Technische Universität Kaiserslautern(凯泽斯劳滕工业大学);German Research Center for Artificial Intelligence GmbH (DFKI)(德国人工智能研究中心);Opthalmology Clinic(眼科诊所);National University of Science and Technology (NUST)(国立科技大学);National Center of Artificial Intelligence(国家人工智能中心);Smart Data and Knowledge Services(智能数据与知识服务部)
Scarcity of large publicly available retinal fundus image datasets for automated glaucoma detection has been the bottleneck for successful application of artificial intelligence towards practical Computer-Aided Diagnosis (CAD). A few small datasets that are available for research community usually suffer from impractical image capturing conditions and stringent inclusion criteria. These shortcomings in already limited choice of existing datasets make it challenging to mature a CAD system so that it can perform in real-world environment. In this paper we present a large publicly available retin…
LaTIM UMR 1101, Inserm(法国国家健康与医学研究院LaTIM UMR 1101实验室);University of Western Brittany(西布列塔尼大学);University of Electronic Science and Technology of China(电子科技大学);IMT Atlantique(大西洋国立高等矿业电信学院)
Diabetic Retinopathy (DR) is a severe complication of diabetes that can cause blindness. Although effective treatments exist (notably laser) to slow the progression of the disease and prevent blindness, the best treatment remains prevention through regular check-ups (at least once a year) with an ophthalmologist. Optical Coherence Tomography Angiography (OCTA) allows for the visualization of the retinal vascularization, and the choroid at the microvascular level in great detail. This allows doctors to diagnose DR with more precision. In recent years, algorithms for DR diagnosis have emerged al…
Observing retinal fundus images by an ophthalmologist is a major diagnosis approach for glaucoma. However, it is still difficult to distinguish the features of the lesion solely through manual observations, especially, in glaucoma early phase. In this paper, we present two deep learning-based automated algorithms for glaucoma detection and optic disc and cup segmentation. We utilize the attention mechanism to learn pixel-wise features for accurate prediction. In particular, we present two convolutional neural networks that can focus on learning various pixel-wise level features. In addition, w…
Segmentation of retinal vessel images is critical to the diagnosis of retinopathy. Recently, convolutional neural networks have shown significant ability to extract the blood vessel structure. However, it remains challenging to refined segmentation for the capillaries and the edges of retinal vessels due to thickness inconsistencies and blurry boundaries. In this paper, we propose a novel deep neural network for retinal vessel segmentation based on shared decoder and pyramid-like loss (SPNet) to address the above problems. Specifically, we introduce a decoder-sharing mechanism to capture multi…
Usher Institute, University of Edinburgh(爱丁堡大学厄舍研究所);Princess Alexandra Eye Pavilion, NHS Lothian(洛锡安国民保健制度亚历山德拉公主眼科馆);Edinburgh Imaging, University of Edinburgh(爱丁堡大学爱丁堡影像中心);Health Data Research UK(英国健康数据研究所);School of Clinical Sciences, University of Edinburgh(爱丁堡大学临床科学学院);Centre for Clinical Brain Sciences, University of Edinburgh(爱丁堡大学临床脑科学中心)
Optical coherence tomography angiography (OCTA) is a novel non-invasive imaging modality for the visualisation of microvasculature in vivo that has encountered broad adoption in retinal research. OCTA potential in the assessment of pathological conditions and the reproducibility of studies relies on the quality of the image analysis. However, automated segmentation of parafoveal OCTA images is still an open problem. In this study, we generate the first open dataset of retinal parafoveal OCTA images with associated ground truth manual segmentations. Furthermore, we establish a standard for OCTA…
Nanjing University of Science and Technology(南京理工大学)
Optical coherence tomography angiography (OCTA) is a novel imaging modality that has been widely utilized in ophthalmology and neuroscience studies to observe retinal vessels and microvascular systems. However, publicly available OCTA datasets remain scarce. In this paper, we introduce the largest and most comprehensive OCTA dataset dubbed OCTA-500, which contains OCTA imaging under two fields of view (FOVs) from 500 subjects. The dataset provides rich images and annotations including two modalities (OCT/OCTA volumes), six types of projections, four types of text labels (age / gender / eye / d…
Retinal vessel segmentation is a crucial step in diagnosing and screening various diseases, including diabetes, ophthalmologic diseases, and cardiovascular diseases. In this paper, we propose an effective and efficient method for vessel segmentation in color fundus images using encoder-decoder based octave convolution networks. Compared with other convolution networks utilizing standard convolution for feature extraction, the proposed method utilizes octave convolutions and octave transposed convolutions for learning multiple-spatial-frequency features, thus can better capture retinal vasculat…
Casey Eye Institute, Oregon Health & Science University(俄勒冈健康与科学大学凯西眼科研究所);School of Physics and Optoelectronic Engineering, Foshan University(佛山大学物理与光电工程学院);Department of Biomedical Engineering, Oregon Health & Science University(俄勒冈健康与科学大学生物医学工程系)
Purpose: We proposed a deep convolutional neural network (CNN), named Retinal Fluid Segmentation Network (ReF-Net) to segment volumetric retinal fluid on optical coherence tomography (OCT) volume. Methods: 3 x 3-mm OCT scans were acquired on one eye by a 70-kHz OCT commercial AngioVue system (RTVue-XR; Optovue, Inc.) from 51 participants in a clinical diabetic retinopathy (DR) study (45 with retinal edema and 6 healthy controls). A CNN with U-Net-like architecture was constructed to detect and segment the retinal fluid. Cross-sectional OCT and angiography (OCTA) scans were used for training an…
University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Stein Eye Institute(斯坦眼科研究所);VoxelCloud, Inc.(体素云公司)
The retinal vasculature provides important clues in the diagnosis and monitoring of systemic diseases including hypertension and diabetes. The microvascular system is of primary involvement in such conditions, and the retina is the only anatomical site where the microvasculature can be directly observed. The objective assessment of retinal vessels has long been considered a surrogate biomarker for systemic vascular diseases, and with recent advancements in retinal imaging and computer vision technologies, this topic has become the subject of renewed attention. In this paper, we present a novel…
Optical coherence tomography angiography (OCTA) can visualize vasculature structures, but provides limited information about the blood flow speeds. Here, we present a second generation variable interscan time analysis (VISTA) OCTA, which evaluates a quantitative surrogate marker for blood flow speed in vasculature. At the capillary level, spatially compiled OCTA and a simple temporal autocorrelation model, ρ(τ) = exp(-ατ), were used to evaluate a temporal autocorrelation decay constant, α, as the blood flow speed marker. A 600 kHz A-scan rate swept-source provides short interscan time OCTA and…
GrInAdapt: Scaling Retinal Vessel Structural Map Segmentation Through Grounding, Integrating and Adapting Multi-device, Multi-site, and Multi-modal Fundus Domains
Department of Bioengineering, University of Washington(华盛顿大学生物工程系);Department of Electrical and Computer Engineering, University of Washington(华盛顿大学电气与计算机工程系);Department of Ophthalmology, University of Washington(华盛顿大学眼科系)
Technical University of Munich(慕尼黑工业大学);Imperial College London(帝国理工学院);University of Zurich(苏黎世大学)
Optical coherence tomography angiography (OCTA) can non-invasively image the eye's circulatory system. In order to reliably characterize the retinal vasculature, there is a need to automatically extract quantitative metrics from these images. The calculation of such biomarkers requires a precise semantic segmentation of the blood vessels. However, deep-learning-based methods for segmentation mostly rely on supervised training with voxel-level annotations, which are costly to obtain. In this work, we present a pipeline to synthesize large amounts of realistic OCTA images with intrinsically matc…
Eindhoven University of Technology(埃因霍温理工大学);Northeastern University(东北大学)
Retinal microaneurysms are the earliest clinical sign of diabetic retinopathy disease. Detection of microaneurysms is crucial for the early diagnosis of diabetic retinopathy and prevention of blindness. In this paper, a novel and reliable method for automatic detection of microaneurysms in retinal images is proposed. In the first stage of the proposed method, several preliminary microaneurysm candidates are extracted using a gradient weighting technique and an iterative thresholding approach. In the next stage, in addition to intensity and shape descriptors, a new set of features based on loca…
Center for Cognitive Skill Enhancement(认知技能提升中心);Independent University Bangladesh(孟加拉国独立大学);University of Nevada, Reno(内华达大学雷诺分校)
Diagnosing different retinal diseases from Spectral Domain Optical Coherence Tomography (SD-OCT) images is a challenging task. Different automated approaches such as image processing, machine learning and deep learning algorithms have been used for early detection and diagnosis of retinal diseases. Unfortunately, these are prone to error and computational inefficiency, which requires further intervention from human experts. In this paper, we propose a novel convolution neural network architecture to successfully distinguish between different degeneration of retinal layers and their underlying …
Retinal optical coherence tomography (OCT) and OCT angiography (OCTA) suffer from the degeneration of image quality due to speckle noise and bulk-motion noise, respectively. Because the cross-sectional retina has distinct features in OCT and OCTA B-scans, existing digital filters that can denoise OCT efficiently are unable to handle the bulk-motion noise in OCTA. In this Letter, we propose a universal digital filtering approach that is capable of minimizing both types of noise. Considering the retinal capillaries in OCTA are hard to differentiate in B-scans while having distinct curvilinear st…
Robust Detection of Retinal Neovascularization in Widefield Optical Coherence Tomography
Casey Eye Institute, Oregon Health & Science University(俄勒冈健康与科学大学凯西眼科研究所);Department of Biomedical Engineering, Oregon Health & Science University(俄勒冈健康与科学大学生物医学工程系);Department of Ophthalmology, Mackay Memorial Hospital(马偕纪念医院眼科);Department of Ophthalmology, Aichi Medical University(爱知医科大学眼科)
Southern University of Science and Technology(南方科技大学);The University of Hong Kong(香港大学)
Various deep learning models have been developed to segment anatomical structures from medical images, but they typically have poor performance when tested on another target domain with different data distribution. Recently, unsupervised domain adaptation methods have been proposed to alleviate this so-called domain shift issue, but most of them are designed for scenarios with relatively small domain shifts and are likely to fail when encountering a large domain gap. In this paper, we propose DCDA, a novel cross-modality unsupervised domain adaptation framework for tasks with large domain shif…
University of Nevada, Reno(内华达大学雷诺分校);Houston Eye Associates(休斯顿眼科协会)
In Fluorescein Angiography (FA), an exogenous dye is injected in the bloodstream to image the vascular structure of the retina. The injected dye can cause adverse reactions such as nausea, vomiting, anaphylactic shock, and even death. In contrast, color fundus imaging is a non-invasive technique used for photographing the retina but does not have sufficient fidelity for capturing its vascular structure. The only non-invasive method for capturing retinal vasculature is optical coherence tomography-angiography (OCTA). However, OCTA equipment is quite expensive, and stable imaging is limited to s…
Beyond the Eye: A Relational Model for Early Dementia Detection Using Retinal OCTA Images
Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences(中国科学院宁波材料技术与工程研究所);West China Hospital, Sichuan University(四川大学华西医院);Edge Hill University(边山大学);Institute of High-Performance Computing, Agency for Science, Technology and Research(新加坡科技研究局高性能计算研究所);School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院)
Optical coherence tomography (OCT) scanning is useful in detecting various retinal diseases. However, there are not enough ophthalmologists who can diagnose retinal OCT images in much of the world. To provide OCT screening inexpensively and extensively, an automated diagnosis system is indispensable. Although many machine learning techniques have been presented for assisting ophthalmologists in diagnosing retinal OCT images, there is no technique that can diagnose independently without relying on an ophthalmologist, i.e., there is no technique that does not overlook any anomaly, including unle…
Nanyang Technological University(南洋理工大学);Inception Institute of Artificial Intelligence (IIAI)(起源人工智能研究院);Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所);Nanjing University of Science and Technology(南京理工大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Retinal images have been widely used by clinicians for early diagnosis of ocular diseases. However, the quality of retinal images is often clinically unsatisfactory due to eye lesions and imperfect imaging process. One of the most challenging quality degradation issues in retinal images is non-uniform which hinders the pathological information and further impairs the diagnosis of ophthalmologists and computer-aided analysis.To address this issue, we propose a non-uniform illumination removal network for retinal image, called NuI-Go, which consists of three Recursive Non-local Encoder-Decoder R…
Deep learning methods for ophthalmic diagnosis have shown considerable success in tasks like segmentation and classification. However, their widespread application is limited due to the models being opaque and vulnerable to making a wrong decision in complicated cases. Explainability methods show the features that a system used to make prediction while uncertainty awareness is the ability of a system to highlight when it is not sure about the decision. This is one of the first studies using uncertainty and explanations for informed clinical decision making. We perform uncertainty analysis of a…
University of Nevada, Reno(内华达大学里诺分校);Deakin University(迪肯大学);Houston Eye Associates(休斯顿眼科协会);University of Nevada School of Medicine(内华达大学医学院)
Carrying out clinical diagnosis of retinal vascular degeneration using Fluorescein Angiography (FA) is a time consuming process and can pose significant adverse effects on the patient. Angiography requires insertion of a dye that may cause severe adverse effects and can even be fatal. Currently, there are no non-invasive systems capable of generating Fluorescein Angiography images. However, retinal fundus photography is a non-invasive imaging technique that can be completed in a few seconds. In order to eliminate the need for FA, we propose a conditional generative adversarial network (GAN) to…
Interpretable Few-Shot Retinal Disease Diagnosis with Concept-Guided Prompting of Vision-Language Models
Monash University(莫纳什大学);Centre for Eye Research Australia(澳大利亚眼科研究中心);Royal Victorian Eye and Ear Hospital(皇家维多利亚眼耳医院);The University of Melbourne(墨尔本大学);The Hong Kong Polytechnic University(香港理工大学);Centre for Eye and Vision Research(眼与视觉研究中心);Indian Institute of Technology Bombay(印度理工学院孟买分校);Airdoc-Monash Research Lab(Airdoc-莫纳什研究实验室)
National Taiwan University(台湾大学);Chang Gung Memorial Hospital(长庚纪念医院);Chang Gung University(长庚大学)
Automated vascular segmentation on optical coherence tomography angiography (OCTA) is important for the quantitative analyses of retinal microvasculature in neuroretinal and systemic diseases. Despite recent improvements, artifacts continue to pose challenges in segmentation. Our study focused on removing the speckle noise artifact from OCTA images when performing segmentation. Speckle noise is common in OCTA and is particularly prominent over large non-perfusion areas. It may interfere with the proper assessment of retinal vasculature. In this study, we proposed a novel Supervision Vessel Seg…
Central South University(中南大学);Hunan Province Engineering Technology Research Center of Computer Vision and Intelligent Medical Treatment(湖南省计算机视觉与智能医疗工程技术研究中心)
Retinal image quality assessment is an essential task in the diagnosis of retinal diseases. Recently, there are emerging deep models to grade quality of retinal images. Current state-of-the-arts either directly transfer classification networks originally designed for natural images to quality classification of retinal images or introduce extra image quality priors via multiple CNN branches or independent CNNs. This paper proposes a dark and bright channel prior guided deep network for retinal image quality assessment called GuidedNet. Specifically, the dark and bright channel priors are embedd…
The Pingry School(平格里学校);Chinle Comprehensive Health Care Facility(钦利综合医疗中心);University of Maryland, College Park(马里兰大学帕克分校);NVIDIA(英伟达)
30 million Optical Coherence Tomography (OCT) imaging tests are issued annually to diagnose various retinal diseases, but accurate diagnosis of OCT scans requires trained eye care professionals who are still prone to making errors. With better systems for diagnosis, many cases of vision loss caused by retinal disease could be entirely avoided. In this work, we present ReLaX, a novel deep learning framework for explainable, accurate classification of retinal pathologies which achieves state-of-the-art accuracy. Furthermore, we emphasize producing both qualitative and quantitative explanations o…
Generative artificial intelligence in ophthalmology: multimodal retinal images for the diagnosis of Alzheimer's disease with convolutional neural networks
Universidad Nacional de Colombia(哥伦比亚国立大学);Fundación Oftalmológica Nacional(国家眼科基金会);Universidad del Rosario(罗萨里奥大学)
Diabetic retinopathy (DR) is the result of a complication of diabetes affecting the retina. It can cause blindness, if left undiagnosed and untreated. An ophthalmologist performs the diagnosis by screening each patient and analyzing the retinal lesions via ocular imaging. In practice, such analysis is time-consuming and cumbersome to perform. This paper presents a model for automatic DR classification on eye fundus images. The approach identifies the main ocular lesions related to DR and subsequently diagnoses the illness. The proposed method follows the same workflow as the clinicians, provid…
Optical Coherence Tomography Angiography-OCTA dataset for the study of Diabetic Retinopathy
Symbiosis Institute of Technology, Symbiosis International (Deemed University)(共生国际( deemed 大学)共生技术学院);University of Technology Sydney(悉尼科技大学);Natasha Eye Care(娜塔莎眼科护理中心)
Controllable retinal image synthesis using conditional StyleGAN and latent space manipulation for improved diagnosis and grading of diabetic retinopathy
Amirkabir University of Technology(阿米尔卡比尔理工大学);Tehran Medical Sciences, Islamic Azad University(伊斯兰阿扎德大学德黑兰医学科学分校)