Multiscale Softmax Cross Entropy for Fovea Localization on Color Fundus Photography
Institute of Imaging and Computer Vision, RWTH Aachen, Germany（成像与计算机视觉研究所，RWTH亚琛，德国）；Department of Ophthalmology, RWTH Aachen, Germany（眼科部门，RWTH亚琛，德国）
Fovea localization is one of the most popular tasks in ophthalmic medical image analysis, where the coordinates of the center point of the macula lutea, i.e. fovea centralis, should be calculated based on color fundus images. In this work, we treat the localization problem as a classification task, where the coordinates of the x- and y-axis are considered as the target classes. Moreover, the combination of the softmax activation function and the cross entropy loss function is modified to its multiscale variation to encourage the predicted coordinates to be located closely to the ground-truths. Based on color fundus photography images, we empirically show that the proposed multiscale softmax cross entropy yields better performance than the vanilla version and than the mean squared error loss with sigmoid activation, which provides a novel approach for coordinate regression.
University of California, Santa Barbara（加利福尼亚大学圣巴巴拉分校）
Fundus photography has routinely been used to document the presence and severity of retinal degenerative diseases such as age-related macular degeneration (AMD), glaucoma, and diabetic retinopathy (DR) in clinical practice, for which the fovea and optic disc (OD) are important retinal landmarks. However, the occurrence of lesions, drusen, and other retinal abnormalities during retinal degeneration severely complicates automatic landmark detection and segmentation. Here we propose HBA-U-Net: a U-Net backbone enriched with hierarchical bottleneck attention. The network consists of a novel bottle…
Sun Yat-sen University（中山大学）；Baidu Inc.（百度公司）；Agency for Science, Technology and Research（新加坡科技研究局）；CONICET（国家科学技术研究委员会）；Medical University of Vienna（维也纳医科大学）；VUNO Inc.（VUNO公司）；Inserm（法国国家健康与医学研究院）；Univ Bretagne Occidentale（西布列塔尼大学）；Zasti（Zasti公司）
Age-related macular degeneration (AMD) is the leading cause of visual impairment among elderly in the world. Early detection of AMD is of great importance, as the vision loss caused by this disease is irreversible and permanent. Color fundus photography is the most cost-effective imaging modality to screen for retinal disorders. Cutting edge deep learning based algorithms have been recently developed for automatically detecting AMD from fundus images. However, there are still lack of a comprehensive annotated dataset and standard evaluation benchmarks. To deal with this issue, we set up the Au…
Sun Yat-sen University（中山大学）；Baidu Inc.（百度公司）；Agency for Science, Technology and Research（新加坡科技研究局）；CONICET（阿根廷国家科学技术研究委员会）；UNICEN（阿根廷中央国立大学）；Medical University of Vienna（维也纳医科大学）；VUNO Inc.（VUNO公司）；Tencent（腾讯）
With the rapid development of artificial intelligence (AI) in medical image processing, deep learning in color fundus photography (CFP) analysis is also evolving. Although there are some open-source, labeled datasets of CFPs in the ophthalmology community, large-scale datasets for screening only have labels of disease categories, and datasets with annotations of fundus structures are usually small in size. In addition, labeling standards are not uniform across datasets, and there is no clear information on the acquisition device. Here we release a multi-annotation, multi-quality, and multi-dev…
University of Nevada, Reno（内华达大学里诺分校）；Deakin University（迪肯大学）；Houston Eye Associates（休斯顿眼科协会）；University of Nevada School of Medicine（内华达大学医学院）
Carrying out clinical diagnosis of retinal vascular degeneration using Fluorescein Angiography (FA) is a time consuming process and can pose significant adverse effects on the patient. Angiography requires insertion of a dye that may cause severe adverse effects and can even be fatal. Currently, there are no non-invasive systems capable of generating Fluorescein Angiography images. However, retinal fundus photography is a non-invasive imaging technique that can be completed in a few seconds. In order to eliminate the need for FA, we propose a conditional generative adversarial network (GAN) to…
Baidu Inc.（百度公司）；Zhongshan Ophthalmic Center, Sun Yat-sen University（中山大学中山眼科中心）；Xiamen University（厦门大学）
Color fundus photography and Optical Coherence Tomography (OCT) are the two most cost-effective tools for glaucoma screening. Both two modalities of images have prominent biomarkers to indicate glaucoma suspected. Clinically, it is often recommended to take both of the screenings for a more accurate and reliable diagnosis. However, although numerous algorithms are proposed based on fundus images or OCT volumes in computer-aided diagnosis, there are still few methods leveraging both of the modalities for the glaucoma assessment. Inspired by the success of Retinal Fundus Glaucoma Challenge (REFU…
Age related macular degeneration (AMD) is one of the major causes for blindness in the elderly population. In this report, we propose deep learning based methods for retinal analysis using color fundus images for computer aided diagnosis of AMD. We leverage the recent state of the art deep networks for building a single fundus image based AMD classification pipeline. We also propose methods for the other directly relevant and auxiliary tasks such as lesions detection and segmentation, fovea detection and optic disc segmentation. We propose the use of generative adversarial networks (GANs) for …
The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；Shenzhen Research Institute of Big Data（深圳大数据研究院）；University of Science and Technology of China（中国科学技术大学）
Diabetic retinopathy is the most important complication of diabetes. Early diagnosis of retinal lesions helps to avoid visual loss or blindness. Due to high-resolution and small-size lesion regions, applying existing methods, such as U-Nets, to perform segmentation on fundus photography is very challenging. Although downsampling the input images could simplify the problem, it loses detailed information. Conducting patch-level analysis helps reaching fine-scale segmentation yet usually leads to misunderstanding as the lack of context information. In this paper, we propose an efficient network t…
Google Research（谷歌研究院）；Google DeepMind（谷歌DeepMind）；NIHR Biomedical Research Centre for Ophthalmology（NIHR眼科生物医学研究中心）；Moorfields Eye Hospital NHS Foundation Trust（摩尔菲尔德眼科医院NHS基金会信托）；UCL Institute of Ophthalmology（伦敦大学学院眼科研究所）
Refractive error, one of the leading cause of visual impairment, can be corrected by simple interventions like prescribing eyeglasses. We trained a deep learning algorithm to predict refractive error from the fundus photographs from participants in the UK Biobank cohort, which were 45 degree field of view images and the AREDS clinical trial, which contained 30 degree field of view images. Our model use the "attention" method to identify features that are correlated with refractive error. Mean absolute error (MAE) of the algorithm's prediction compared to the refractive error obtained in the AR…
In this paper, we propose two distinct solutions to the problem of Diabetic Retinopathy (DR) classification. In the first approach, we introduce a shallow neural network architecture. This model performs well on classification of the most frequent classes while fails at classifying the less frequent ones. In the second approach, we use transfer learning to re-train the last modified layer of a very deep neural network to improve the generalization ability of the model to the less frequent classes. Our results demonstrate superior abilities of transfer learning in DR classification of less freq…
This study is to test the feasibility of using trans-pars-planar illumination for ultrawide field pediatric fundus photography. Fundus examination of the peripheral retina is essential for clinical management of pediatric eye diseases. However, current pediatric fundus cameras with traditional trans-pupillary illumination provide a limited field of view (FOV), making it difficult to access the peripheral retina adequately for a comprehensive assessment of eye conditions. Here, we report the first demonstration of trans-pars-planar illumination in ultra-wide field pediatric fundus photography. …
Ultra-widefield (UWF) imaging is a promising modality that captures a larger retinal field of view compared to traditional fundus photography. Previous studies showed that deep learning (DL) models are effective for detecting retinal disease in UWF images, but primarily considered individual diseases under less-than-realistic conditions (excluding images with other diseases, artefacts, comorbidities, or borderline cases; and balancing healthy and diseased images) and did not systematically investigate which regions of the UWF images are relevant for disease detection. We first improve on the s…
Sirindhorn International Institute of Technology, Thammasat University（泰国国立法政大学诗琳通国际技术学院）
Diabetic retinopathy is an eye-related pathology creating abnormalities and causing visual impairment, proper treatment of which requires identifying irregularities. This research uses a hemorrhage detection method and compares classification of conventional and deep features. Especially, method identifies hemorrhage connected with blood vessels or reside at retinal border and reported challenging. Initially, adaptive brightness adjustment and contrast enhancement rectify degraded images. Prospective locations of hemorrhages are estimated by a Gaussian matched filter, entropy thresholding, and…
Siksha ‘O’ Anusandhan (Deemed to be University)（锡克沙奥阿努山丹大学（被认定为大学））；ITER, Siksha ‘O’ Anusandhan (Deemed to be University)（锡克沙奥阿努山丹大学（被认定为大学）ITER学院）；Center for the Internet of Things, ITER, Siksha ‘O’ Anusandhan (Deemed to be University)（锡克沙奥阿努山丹大学（被认定为大学）ITER学院物联网中心）
Extracting blood vessels from retinal fundus images plays a decisive role in diagnosing the progression in pertinent diseases. In medical image analysis, vessel extraction is a semantic binary segmentation problem, where blood vasculature needs to be extracted from the background. Here, we present an image enhancement technique based on the morphological preprocessing coupled with a scaled U-net architecture. Despite a relatively less number of trainable network parameters, the scaled version of U-net architecture provides better performance compare to other methods in the domain. We validated…
University of Nevada, Reno（内华达大学雷诺分校）；Deakin University（迪肯大学）；Houston Eye Associates（休斯顿眼科协会）
Fluorescein Angiography (FA) is a technique that employs the designated camera for Fundus photography incorporating excitation and barrier filters. FA also requires fluorescein dye that is injected intravenously, which might cause adverse effects ranging from nausea, vomiting to even fatal anaphylaxis. Currently, no other fast and non-invasive technique exists that can generate FA without coupling with Fundus photography. To eradicate the need for an invasive FA extraction procedure, we introduce an Attention-based Generative network that can synthesize Fluorescein Angiography from Fundus imag…
Fundus2Video: Cross-Modal Angiography Video Generation from Static Fundus Photography with Clinical Knowledge Guidance
The Hong Kong Polytechnic University（香港理工大学）；Clemson University（克莱姆森大学）；École Polytechnique Fédérale de Lausanne (EPFL)（洛桑联邦理工学院）；Monash University（莫纳什大学）；Sun Yat-sen University（中山大学）
Medical University of Vienna（维也纳医科大学）；Inception Institute of Artificial Intelligence（起源人工智能研究院）；University of Porto（波尔图大学）；KU Leuven（鲁汶大学）；Universitat Politècnica de València（瓦伦西亚理工大学）；University of Florida（佛罗里达大学）；The Chinese University of Hong Kong（香港中文大学）；Gachon University（嘉泉大学）；Samsung SDS AI Research Center（三星SDS人工智能研究中心）；Yale University（耶鲁大学）
Glaucoma is one of the leading causes of irreversible but preventable blindness in working age populations. Color fundus photography (CFP) is the most cost-effective imaging modality to screen for retinal disorders. However, its application to glaucoma has been limited to the computation of a few related biomarkers such as the vertical cup-to-disc ratio. Deep learning approaches, although widely applied for medical image analysis, have not been extensively used for glaucoma assessment due to the limited size of the available data sets. Furthermore, the lack of a standardize benchmark strategy …
Fundus Image Quality Assessment and Enhancement: a Systematic Review
Research Institute of Trustworthy Autonomous Systems, SUSTech（南方科技大学可信自主系统研究院）；Department of Computer Science and Engineering, SUSTech（南方科技大学计算机科学与工程系）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Computer School, Beijing Information Science and Technology University（北京信息科技大学计算机学院）；Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局高性能计算研究所）
Propagating Structural Guidance: Synthesizing Fluorescein Angiography from Fundus Images and Sparse OCT Scans
School of Computer Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications, Ministry of Education（教育部新一代人工智能技术及其跨学科应用重点实验室）；Tianyuan Honors School, Nanjing Medical University（南京医科大学天元荣誉学院）；Nanjing University of Science and Technology（南京理工大学）；Department of Ophthalmology, The First Affiliated Hospital of Nanjing Medical University（南京医科大学第一附属医院眼科）
The Computer-Assisted Diagnosis systems could save workloads and give objective diagnostic to ophthalmologists. At first, feature extraction is a fundamental step. One of these retinal features is the fovea. The fovea is a small fossa on the fundus. The main vessels diverge from the optic nerve head and follow a specific course that can be geometrically modeled as a parabola, with a common vertex inside the optic nerve head and the fovea located along the apex of this parabola curve. Therefore, based on this assumption, the main retinal blood vessels are segmented and fitted to a parabolic mod…
Shanghai Jiao Tong University（上海交通大学）；VoxelCloud, Inc.（体素科技有限公司）；University of Liverpool（利物浦大学）；Xi’an Jiaotong-Liverpool University（西交利物浦大学）
The fovea is an important anatomical landmark of the retina. Detecting the location of the fovea is essential for the analysis of many retinal diseases. However, robust fovea localization remains a challenging problem, as the fovea region often appears fuzzy, and retina diseases may further obscure its appearance. This paper proposes a novel Vision Transformer (ViT) approach that integrates information both inside and outside the fovea region to achieve robust fovea localization. Our proposed network, named Bilateral-Vision-Transformer (Bilateral-ViT), consists of two network branches: a trans…
Fundus photography is indispensable for clinical detection and management of eye diseases. Limited image contrast and field of view (FOV) are common limitations of conventional fundus cameras, making it difficult to detect subtle abnormalities at the early stages of eye diseases. Further improvements of image contrast and FOV coverage are important to improve early disease detection and reliable treatment assessment. We report here a portable fundus camera, with a wide FOV and high dynamic range (HDR) imaging capabilities. Miniaturized indirect ophthalmoscopy illumination was employed to achie…
APTOS-2024 challenge report: Generation of synthetic 3D OCT images from fundus photographs
The Hong Kong Polytechnic University（香港理工大学）；Rangsit University（兰实大学）；Rajavithi Hospital（拉差维提医院）；Monash University（莫纳什大学）；Nanjing University of Science and Technology（南京理工大学）；Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局高性能计算研究院）；Mayo Clinic（梅奥诊所）；China Medical University（中国医科大学）；Northeastern University（东北大学）；Henan Kaifeng College of Science Technology and Communication（河南开封科技传媒学院）；University of Electronic Science and Technology of China（电子科技大学）；Centre for Eye and Vision Research (CEVR)（眼科与视觉研究中心）
State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Vision Science, Guangdong Provincial Clinical Research Center for Ocular Diseases（眼科学国家重点实验室、中山眼科中心、中山大学、广东省眼科学重点实验室和视觉科学、广东省眼科临床研究中心）；Faculty of Data Science, City University of Macau（澳门城市大学数据科学学院）；Hainan International College, Minzu University of China（海南国际学院，中国民族大学）；School of Information Technology, Faculty of Business and Hospitality, Torrens University Australia（澳大利亚托伦斯大学信息科技学院，商业与酒店管理学院）；AIM for Health Lab, Faculty of IT, Monash University, Australia（健康AIM实验室，墨尔本大学IT学院，澳大利亚）；Department of Ophthalmology, Guangzhou First People’s Hospital, the Second Affiliated Hospital of South China University of Technology（广州第一人民医院，华南理工大学第二附属医院）；The Third Xiangya Hospital of Central South University（中南大学湘雅医学院第三医院）
Cross-Fundus Transformer for Multi-modal Diabetic Retinopathy Grading with Cataract
Academy for Engineering and Technology, Fudan University（复旦大学工程技术研究院）；School of Computer Science, Fudan University（复旦大学计算机科学技术学院）；Shanghai Eye Diseases Prevention & Treatment Center（上海眼病防治中心）；Shanghai Jiao Tong University School of Medicine（上海交通大学医学院）
EyeMVP: OCT-Informed Fundus Representation Learning via Paired CFP--OCT Pretraining
Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University（首都医科大学附属北京同仁医院北京同仁眼科中心）；Liangxiang Hospital of Beijing Fangshan District, Capital Medical University（首都医科大学北京市房山区良乡医院）；The Third People's Hospital of Dalian（大连市第三人民医院）；National Clinical Research Center for Endocrine and Metabolic Diseases, The Second Xiangya Hospital of Central South University（中南大学湘雅二医院国家内分泌代谢病临床医学研究中心）；The Central Hospital of Baoji City（宝鸡市中心医院）；Wuxi No.2 People's Hospital, Affiliated Wuxi Clinical College of Nantong University（南通大学附属无锡临床学院无锡市第二人民医院）；Shenzhen Eye Hospital, Southern Medical University（南方医科大学深圳眼科医院）；Beijing Friendship Hospital, Capital Medical University（首都医科大学附属北京友谊医院）
Southern University of Science and Technology（南方科技大学）；A*STAR（新加坡科技研究局）；New York University（纽约大学）；Chinese Academy of Sciences（中国科学院）；Shenzhen People’s Hospital（深圳市人民医院）
Fundus photography is a routine examination in clinics to diagnose and monitor ocular diseases. However, for cataract patients, the fundus image always suffers quality degradation caused by the clouding lens. The degradation prevents reliable diagnosis by ophthalmologists or computer-aided systems. To improve the certainty in clinical diagnosis, restoration algorithms have been proposed to enhance the quality of fundus images. Unfortunately, challenges remain in the deployment of these algorithms, such as collecting sufficient training data and preserving retinal structures. In this paper, to …
Institute of High Performance Computing, A*STAR（新加坡科技研究局高性能计算研究所）；Singapore Eye Research Institute（新加坡眼科研究所）；Singapore National Eye Centre（新加坡全国眼科中心）；Yong Loo Lin School of Medicine, NUS（新加坡国立大学杨潞龄医学院）
Localizing anatomical landmarks are important tasks in medical image analysis. However, the landmarks to be localized often lack prominent visual features. Their locations are elusive and easily confused with the background, and thus precise localization highly depends on the context formed by their surrounding areas. In addition, the required precision is usually higher than segmentation and object detection tasks. Therefore, localization has its unique challenges different from segmentation or detection. In this paper, we propose a zoom-in attentive network (ZIAN) for anatomical landmark loc…
A Generic Fundus Image Enhancement Network Boosted by Frequency Self-supervised Representation Learning
Southern University of Science and Technology（南方科技大学）；Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局高性能计算研究所）；South China University of Technology（华南理工大学）；Pazhou Lab（琶洲实验室）；New York University（纽约大学）；Beijing Information Science and Technology University（北京信息科技大学）
Research Group Ophthalmology, KU Leuven（KU Leuven眼科研究组）；Ophthalmology Department, UZ Leuven（UZ Leuven眼科部）；ESAT-PSI, KU Leuven（KU Leuven ESAT-PSI）；Hasselt University（哈塞尔特大学）；VITO NV
This investigation reports on the results of convolutional neural networks developed for the recently introduced PathologicAL Myopia (PALM) dataset, which consists of 1200 fundus images. We propose a new Optic Nerve Head (ONH)-based prediction enhancement for the segmentation of atrophy and fovea. Models trained with 400 available training images achieved an AUC of 0.9867 for pathological myopia classification, and a Euclidean distance of 58.27 pixels on the fovea localization task, evaluated on a test set of 400 images. Dice and F1 metrics for semantic segmentation of lesions scored 0.9303 an…
Laboratory of Technological Innovation in Health, Federal University of Rio Grande do Norte（联邦里约格兰德大学健康技术创新实验室）
In this paper we present algorithms to diagnosis Pathological Myopia (PM) and detection of retinal structures and lesions such asOptic Disc (OD), Fovea, Atrophy and Detachment. All these tasks were performed in fundus imaging from PM patients and they are requirements to participate in the Pathologic Myopia Challenge (PALM). The challenge was organized as a half day Challenge, a Satellite Event of The IEEE International Symposium on Biomedical Imaging in Venice Italy.Our method applies different Deep Learning techniques for each task. Transfer learning is applied in all tasks using Xception as…
UWAFA-GAN: Ultra-Wide-Angle Fluorescein Angiography Transformation via Multi-scale Generation and Registration Enhancement
Hangzhou Dianzi University（杭州电子科技大学）；Southern University of Science and Technology（南方科技大学）；Shenzhen University（深圳大学）；Misr Higher Institute for Commerce and Computers（米斯尔高等商务与计算机学院）
In this chapter, we will give a brief overview of fundus photography, SLO, and OCT while discussing photoacoustic imaging potential as the next major ocular imaging modality.
Purpose: To create and evaluate the accuracy of an artificial intelligence Deep learning platform (ORAiCLE) capable of using only retinal fundus images to predict both an individuals overall 5 year cardiovascular risk (CVD) and the relative contribution of the component risk factors that comprise this risk. Methods: We used 165,907 retinal images from a database of 47,236 patient visits. Initially, each image was paired with biometric data age, ethnicity, sex, presence and duration of diabetes a HDL/LDL ratios as well as any CVD event wtihin 5 years of the retinal image acquisition. A risk sco…
MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imaging
Microsoft Health and Life Sciences（微软健康与生命科学部门）；Microsoft Research（微软研究院）；University of Wisconsin-Madison（威斯康星大学麦迪逊分校）；Microsoft Azure AI（微软Azure人工智能部门）
SAM2-SGP: Enhancing SAM2 for Medical Image Segmentation via Support-Set Guided Prompting
J. Crayton Pruitt Family Department of Biomedical Engineering University of Florida；Department of Electrical \& Computer Engineering University of Florida
Harnessing the power of longitudinal medical imaging for eye disease prognosis using Transformer-based sequence modeling
Weill Cornell Medicine（威尔康奈尔医学院）；The University of Texas at Austin（德克萨斯大学奥斯汀分校）；Washington University School of Medicine（华盛顿大学医学院）；Columbia University（哥伦比亚大学）；National Eye Institute（国家眼科研究所）；National Institutes of Health (NIH)（美国国立卫生研究院）；National Center for Biotechnology Information (NCBI)（国家生物技术信息中心）；National Library of Medicine (NLM)（国家医学图书馆）
ITER, Siksha ‘O’ Anusandhan (Deemed to be University)（ITER，锡克沙·奥·阿努桑德汉（被视为大学））
In the medical domain, different computer-aided diagnosis systems have been proposed to extract blood vessels from retinal fundus images for the clinical treatment of vascular diseases. Accurate extraction of blood vessels from the fundus images using a computer-generated method can help the clinician to produce timely and accurate reports for the patient suffering from these diseases. In this article, we integrate top-hat based preprocessing approach with fine-tuned B-COSFIRE filter to achieve more accurate segregation of blood vessel pixels from the background. The use of top-hat transformat…
Fundus photography (FP) remains the primary imaging modality in screening various retinal diseases including age-related macular degeneration, diabetic retinopathy and glaucoma. FP allows the clinician to examine the ocular fundus structures such as the macula, the optic disc (OD) and retinal vessels, whose visibility and clarity in an FP image remain central to ensuring diagnostic accuracy, and hence determine the diagnostic quality (DQ). Images with low DQ, resulting from eye movement, improper illumination and other possible causes, should obviously be recaptured. However, the technician, o…
Interpretable Retinal Disease Prediction Using Biology-Informed Heterogeneous Graph Representations
Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）；School of Medicine and Health, TUM University Hospital（医学与健康学院，塔尔博恩大学医院）；School of Computation, Information and Technology, TUM（计算、信息与技术学院，塔尔博恩大学）；Weill Cornell Medicine, Cornell University, New York City（韦尔·科恩医学中心，康奈尔大学，纽约市）
UrFound: Towards Universal Retinal Foundation Models via Knowledge-Guided Masked Modeling
Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)（高性能计算研究所（A*STAR））；Singapore Eye Research Institute, Singapore National Eye Centre（新加坡眼科研究所，新加坡国家眼科中心）
Friedrich-Alexander University（弗里德里希-亚历山大大学）；International Max Planck Research School Physics of Light (IMPRS-PL)（国际马克斯·普朗克光物理研究学院（IMPRS-PL））；MIT（麻省理工学院）
Fundus photography and Optical Coherence Tomography Angiography (OCT-A) are two commonly used modalities in ophthalmic imaging. With the development of deep learning algorithms, fundus image processing, especially retinal vessel segmentation, has been extensively studied. Built upon the known operator theory, interpretable deep network pipelines with well-defined modules have been constructed on fundus images. In this work, we firstly train a modularized network pipeline for the task of retinal vessel segmentation on the fundus database DRIVE. The pretrained preprocessing module from the pipel…
Arizona State University（亚利桑那州立大学）；Washington University in St. Louis（圣路易斯华盛顿大学）；Mayo Clinic（梅奥诊所）
Real-world non-mydriatic retinal fundus photography is prone to artifacts, imperfections and low-quality when certain ocular or systemic co-morbidities exist. Artifacts may result in inaccuracy or ambiguity in clinical diagnoses. In this paper, we proposed a simple but effective end-to-end framework for enhancing poor-quality retinal fundus images. Leveraging the optimal transport theory, we proposed an unpaired image-to-image translation scheme for transporting low-quality images to their high-quality counterparts. We theoretically proved that a Generative Adversarial Networks (GAN) model wit…
Prediction of Alzheimer's Disease Risk Factors from Retinal Images via Deep Learning: Development and Validation of Biologically Relevant Morphological Associations in the UK Biobank
J. Crayton Pruitt Family Dept. of Biomedical Engineering, University of Florida（朱·克雷顿·普瑞特生物医学工程系，佛罗里达大学）；University of Florida Research Computing（佛罗里达大学研究计算中心）；Meta AI (FAIR)（Meta AI（FAIR））；School of Behavioral and Brain Sciences, University of Texas at Dallas（德克萨斯大学达拉斯分校行为与脑科学学院）；Dept. of Electrical and Computer Engineering, University of Florida（佛罗里达大学电气与计算机工程系）；Dept. of Computer and Information Science and Engineering, University of Florida（佛罗里达大学计算机与信息科学与工程系）；Center for Cognitive Aging and Memory, University of Florida（佛罗里达大学认知衰老与记忆中心）
King Saud University（沙特国王大学）；Imam Mohammad Ibn Saud Islamic University (IMSIU)（伊玛目穆罕默德·本·沙特伊斯兰大学）；Princess Nourah bint Abdulrahman University（努拉·宾特·阿卜杜勒·拉赫曼公主大学）；King Faisal University（费萨尔国王大学）；King Khaled Eye Specialist Hospital（哈立德国王眼科专科医院）
The prevalence of diabetic retinopathy (DR) has reached 34.6% worldwide and is a major cause of blindness among middle-aged diabetic patients. Regular DR screening using fundus photography helps detect its complications and prevent its progression to advanced levels. As manual screening is time-consuming and subjective, machine learning (ML) and deep learning (DL) have been employed to aid graders. However, the existing CNN-based methods use either pre-trained CNN models or a brute force approach to design new CNN models, which are not customized to the complexity of fundus images. To overcome…
A Deep Convolutional Neural Network-Based Novel Class Balancing for Imbalance Data Segmentation
Department of Computer Science, COMSATS University Islambad, Lahore Campus, Pakistan（计算机科学系，卡姆斯大学伊斯法罕，拉合尔校区，巴基斯坦）；Hamad Medical Corporation, Qatar（卡塔尔哈马姆医疗集团）；University of Stirling, UK（斯特林大学，英国）
