Generative artificial intelligence in ophthalmology: multimodal retinal images for the diagnosis of Alzheimer's disease with convolutional neural networks
I. R. Slootweg, M. Thach, K. R. Curro-Tafili, F. D. Verbraak, F. H. Bouwman, Y. A. L. Pijnenburg, J. F. Boer, J. H. P. de Kwisthout, L. Bagheriye, P. J. González
Background/Aim. This study aims to predict Amyloid Positron Emission Tomography (AmyloidPET) status with multimodal retinal imaging and convolutional neural networks (CNNs) and to improve the performance through pretraining with synthetic data. Methods. Fundus autofluorescence, optical coherence tomography (OCT), and OCT angiography images from 328 eyes of 59 AmyloidPET positive subjects and 108 AmyloidPET negative subjects were used for classification. Denoising Diffusion Probabilistic Models (DDPMs) were trained to generate synthetic images and unimodal CNNs were pretrained on synthetic data and finetuned on real data or trained solely on real data. Multimodal classifiers were developed to combine predictions of the four unimodal CNNs with patient metadata. Class activation maps of the unimodal classifiers provided insight into the network's attention to inputs. Results. DDPMs generated diverse, realistic images without memorization. Pretraining unimodal CNNs with synthetic data improved AUPR at most from 0.350 to 0.579. Integration of metadata in multimodal CNNs improved AUPR from 0.486 to 0.634, which was the best overall best classifier. Class activation maps highlighted relevant retinal regions which correlated with AD. Conclusion. Our method for generating and leveraging synthetic data has the potential to improve AmyloidPET prediction from multimodal retinal imaging. A DDPM can generate realistic and unique multimodal synthetic retinal images. Our best performing unimodal and multimodal classifiers were not pretrained on synthetic data, however pretraining with synthetic data slightly improved classification performance for two out of the four modalities.
An Explainable Transformer Model for Alzheimer's Disease Detection Using Retinal Imaging
Nanotechnology, Biotechnology, Information Technology and Cognitive Science Laboratory, University of Tehran（特拉布宗大学纳米技术、生物技术、信息技术和认知科学实验室）；Department of Mechatronics, School of Intelligent Systems, College of Interdisciplinary Science and Technology, University of Tehran（特拉布宗大学机电系，智能系统学院，跨学科科学与技术学院）；School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England（新英格兰大学科学与技术学院，科学、农业、商业与法律学院）；Graduate School of Health, University of Technology Sydney（悉尼技术大学健康研究生院）；School of Medicine and Public Health, College of Health, Medicine and Wellbeing, The University of Newcastle（新castle大学医学与公共卫生学院，健康、医学与福祉学院）
Early Alzheimer's Disease Detection from Retinal OCT Images: A UK Biobank Study
Department of Computer Engineering Isik University Istanbul, Turkey（计算机工程系伊斯肯大学）；Department of Artificial Intelligence and Data Engineering（人工智能与数据工程系）；Data Engineering Istanbul Technical University Istanbul, Turkey（数据工程系伊斯坦布尔技术大学）
Optical Coherence Tomography (OCT) is one of the most emerging imaging modalities that has been used widely in the field of biomedical imaging. From its emergence in 1990's, plenty of hardware and software improvements have been made. Its applications range from ophthalmology to dermatology to coronary imaging etc. Here, the focus is on applications of OCT in ophthalmology and retinal imaging. OCT is able to non-invasively produce cross-sectional volume images of the tissues which are further used for analysis of the tissue structure and its properties. Due to the underlying physics, OCT image…
Prediction of Alzheimer's Disease Risk Factors from Retinal Images via Deep Learning: Development and Validation of Biologically Relevant Morphological Associations in the UK Biobank
J. Crayton Pruitt Family Dept. of Biomedical Engineering, University of Florida（朱·克雷顿·普瑞特生物医学工程系，佛罗里达大学）；University of Florida Research Computing（佛罗里达大学研究计算中心）；Meta AI (FAIR)（Meta AI（FAIR））；School of Behavioral and Brain Sciences, University of Texas at Dallas（德克萨斯大学达拉斯分校行为与脑科学学院）；Dept. of Electrical and Computer Engineering, University of Florida（佛罗里达大学电气与计算机工程系）；Dept. of Computer and Information Science and Engineering, University of Florida（佛罗里达大学计算机与信息科学与工程系）；Center for Cognitive Aging and Memory, University of Florida（佛罗里达大学认知衰老与记忆中心）
Retinal Optical Coherence Tomography (OCT), a noninvasive cross-sectional scan of the eye with qualitative 3D visualization of the retinal anatomy is use to study the retinal structure and the presence of pathogens. The advent of the retinal OCT has transformed ophthalmology and it is currently paramount for the diagnosis, monitoring and treatment of many eye pathogens including Macular Edema which impairs vision severely or Glaucoma that can cause irreversible blindness. However the quality of retinal OCT images varies among device manufacturers. Deep Learning methods have had their success i…
OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methods
Friedrich-Alexander-Universität Erlangen-Nürnberg（弗里德里希-亚历山大-埃尔朗根-纽伦堡大学）；Ural Federal University Named after the First President of Russia B. N. Yeltsin（俄罗斯首任总统B.N.叶利钦命名的乌拉尔联邦大学）；Ophthalmosurgery Clinic "Professorskaya Plus"（“Professorskaya Plus”眼科诊所）；Ural State Medical University（乌拉尔国立医科大学）
Sri Venkateswara college of Engineering（斯里文卡特斯瓦拉工程学院）
Teleophthalmology holds a great potential to improve the quality, access, and affordability in health care. For patients, it can reduce the need for travel and provide the access to a superspecialist. Ophthalmology lends itself easily to telemedicine as it is a largely image based diagnosis. The main goal of the proposed system is to diagnose the type of disease in the retina and to automatically detect and segment retinal diseases without human supervision or interaction. The proposed system will diagnose the disease present in the retina using a neural network based classifier.The extent of …
Noise in speckle-prone optical coherence tomography tends to obfuscate important details necessary for medical diagnosis. In this paper, a denoising approach that preserves disease characteristics on retinal optical coherence tomography images in ophthalmology is presented. By combining a deep convolutional autoencoder with a priorly trained ResNet image classifier as regularizer, the perceptibility of delicate details is encouraged and only information-less background noise is filtered out. With our approach, higher peak signal-to-noise ratios with $ \mathrm{PSNR} = 31.2\,\mathrm{dB} $ and hi…
Optical Coherence Tomography (OCT) is an emerging technique in the field of biomedical imaging, with applications in ophthalmology, dermatology, coronary imaging etc. Due to the underlying physics, OCT images usually suffer from a granular pattern, called speckle noise, which restricts the process of interpretation. Here, a sparse and low rank decomposition based method is used for speckle reduction in retinal OCT images. This technique works on input data that consists of several B-scans of the same location. The next step is the batch alignment of the images using a sparse and low-rank decom…
Disentangling representations of retinal images with generative models
Hertie Institute for AI in Brain Health, Faculty of Medicine, University of Tübingen（人工智能与脑健康赫特研究所，医学院，图宾根大学）；Tübingen AI Center, Tübingen, Germany（图宾根人工智能中心，图宾根，德国）；Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism UDEM, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland（糖尿病、内分泌学、营养医学和代谢学部门UDEM，伯尔尼大学医院，伯尔尼大学，伯尔尼，瑞士）；Department of Computer Science, University of Tübingen, Tübingen, Germany（计算机科学系，图宾根大学，图宾根，德国）
The status of retinal arteriovenous crossing is of great significance for clinical evaluation of arteriolosclerosis and systemic hypertension. As an ophthalmology diagnostic criteria, Scheie's classification has been used to grade the severity of arteriolosclerosis. In this paper, we propose a deep learning approach to support the diagnosis process, which, to the best of our knowledge, is one of the earliest attempts in medical imaging. The proposed pipeline is three-fold. First, we adopt segmentation and classification models to automatically obtain vessels in a retinal image with the corresp…
Nanjing University of Science and Technology（南京理工大学）
Optical coherence tomography angiography (OCTA) is a novel imaging modality that has been widely utilized in ophthalmology and neuroscience studies to observe retinal vessels and microvascular systems. However, publicly available OCTA datasets remain scarce. In this paper, we introduce the largest and most comprehensive OCTA dataset dubbed OCTA-500, which contains OCTA imaging under two fields of view (FOVs) from 500 subjects. The dataset provides rich images and annotations including two modalities (OCT/OCTA volumes), six types of projections, four types of text labels (age / gender / eye / d…
CITIC-Research Center of Information and Communication Technologies, University of A Coruña（科蒂克信息与通信技术研究中心，拉科鲁尼亚大学）；Department of Computer Science, University of A Coruña（拉科鲁尼亚大学计算机科学系）；University of A Coruña（拉科鲁尼亚大学）；CITIC-Research Center of Information and Communication Technologies（科蒂克信息与通信技术研究中心）
The analysis of different image modalities is frequently performed in ophthalmology as it provides complementary information for the diagnosis and follow-up of relevant diseases, like hypertension or diabetes. This work presents a hybrid method for the multimodal registration of color fundus retinography and fluorescein angiography. The proposed method combines a feature-based approach, using domain-specific landmarks, with an intensity-based approach that employs a domain-adapted similarity metric. The methodology is tested on a dataset of 59 image pairs containing both healthy and pathologic…
With the advancement of powerful image processing and machine learning techniques, CAD has become ever more prevalent in all fields of medicine including ophthalmology. Since optic disc is the most important part of retinal fundus image for glaucoma detection, this paper proposes a two-stage framework that first detects and localizes optic disc and then classifies it into healthy or glaucomatous. The first stage is based on RCNN and is responsible for localizing and extracting optic disc from a retinal fundus image while the second stage uses Deep CNN to classify the extracted disc into health…
Optical coherence tomography (OCT) is a non-invasive 3D modality widely used in ophthalmology for imaging the retina. Achieving automated, anatomically coherent retinal layer segmentation on OCT is important for the detection and monitoring of different retinal diseases, like Age-related Macular Disease (AMD) or Diabetic Retinopathy. However, the majority of state-of-the-art layer segmentation methods are based on purely supervised deep-learning, requiring a large amount of pixel-level annotated data that is expensive and hard to obtain. With this in mind, we introduce a semi-supervised paradi…
Optical Coherence Tomography (OCT) is an emerging technique in the field of biomedical imaging, with applications in ophthalmology, dermatology, coronary imaging etc. OCT images usually suffer from a granular pattern, called speckle noise, which restricts the process of interpretation. Therefore the need for speckle noise reduction techniques is of high importance. To the best of our knowledge, use of Independent Component Analysis (ICA) techniques has never been explored for speckle reduction of OCT images. Here, a comparative study of several ICA techniques (InfoMax, JADE, FastICA and SOBI) …
The Role of AI in Early Detection of Life-Threatening Diseases: A Retinal Imaging Perspective
Naif Arab University for Security Sciences（奈伊夫阿拉伯安全科学大学）；Charles Sturt University（查尔斯特大学）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
According to the World Health Organization, 285 million people worldwide live with visual impairment. The most commonly used imaging technique for diagnosis in ophthalmology is optical coherence tomography (OCT). However, analysis of retinal OCT requires trained ophthalmologists and time, making a comprehensive early diagnosis unlikely. A recent study established a diagnostic tool based on convolutional neural networks (CNN), which was trained on a large database of retinal OCT images. The performance of the tool in classifying retinal conditions was on par to that of trained medical experts. …
Optical coherence tomography (OCT) is a non-invasive imaging modality which is widely used in clinical ophthalmology. OCT images are capable of visualizing deep retinal layers which is crucial for early diagnosis of retinal diseases. In this paper, we describe a comprehensive open-access database containing more than 500 highresolution images categorized into different pathological conditions. The image classes include Normal (NO), Macular Hole (MH), Age-related Macular Degeneration (AMD), Central Serous Retinopathy (CSR), and Diabetic Retinopathy (DR). The images were obtained from a raster s…
RET-CLIP: A Retinal Image Foundation Model Pre-trained with Clinical Diagnostic Reports
Beijing Institute of Technology（北京理工大学）；Beijing Tongren Hospital（北京同仁医院）；Capital Medical University（首都医科大学）；Beijing Institute of Ophthalmology（北京眼科研究所）
Medical University of Vienna（维也纳医科大学）；Medical University Vienna（维也纳医科大学）
Optical coherence tomography (OCT) has become the most important imaging modality in ophthalmology. A substantial amount of research has recently been devoted to the development of machine learning (ML) models for the identification and quantification of pathological features in OCT images. Among the several sources of variability the ML models have to deal with, a major factor is the acquisition device, which can limit the ML model's generalizability. In this paper, we propose to reduce the image variability across different OCT devices (Spectralis and Cirrus) by using CycleGAN, an unsupervis…
Optical coherence tomography (OCT) is a non-invasive imaging technique widely used for ophthalmology. It can be extended to OCT angiography (OCT-A), which reveals the retinal vasculature with improved contrast. Recent deep learning algorithms produced promising vascular segmentation results; however, 3D retinal vessel segmentation remains difficult due to the lack of manually annotated training data. We propose a learning-based method that is only supervised by a self-synthesized modality named local intensity fusion (LIF). LIF is a capillary-enhanced volume computed directly from the input OC…
Beyond the Eye: A Relational Model for Early Dementia Detection Using Retinal OCTA Images
Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences（中国科学院宁波材料技术与工程研究所）；West China Hospital, Sichuan University（四川大学华西医院）；Edge Hill University（边山大学）；Institute of High-Performance Computing, Agency for Science, Technology and Research（新加坡科技研究局高性能计算研究所）；School of Computer Science and Technology, Beijing Institute of Technology（北京理工大学计算机科学与技术学院）
Block Expanded DINORET: Adapting Natural Domain Foundation Models for Retinal Imaging Without Catastrophic Forgetting
Stadtspital Zürich（苏黎世市立医院）；Spross Research Institute（斯普罗斯研究所）；Gutblick Research（古特布里克研究公司）；Balgrist University Hospital（巴尔格里斯特大学医院）；Moorfields Eye Hospital NHS Foundation Trust（摩尔菲尔德眼科医院国民保健服务基金会信托）；Institute of Ophthalmology, University College London（伦敦大学学院眼科研究所）；University College London（伦敦大学学院）；National University of Singapore（新加坡国立大学）；Singapore Eye Research Institute, Singapore National Eye Centre（新加坡国家眼科中心新加坡眼科研究所）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）；iScreen 2 Prevent LLC（iScreen 2 Prevent有限责任公司）；Bascom Palmer Eye Institute, University of Miami（迈阿密大学巴斯康帕默眼科研究所）；University of Heidelberg（海德堡大学）；Semmelweis University（塞梅尔魏斯大学）
A BERT-Style Self-Supervised Learning CNN for Disease Identification from Retinal Images
School of Computing and Augmented Intelligence, Arizona State University（计算与增强智能学院，亚利桑那州立大学）；McKeley School of Engineering, Washington University in St. Louis（工程学院，华盛顿大学圣路易斯分校）；Department of Neurology, Mayo Clinic（神经病学部，梅奥诊所）
The accurate retinal vessel segmentation (RVS) is of great significance to assist doctors in the diagnosis of ophthalmology diseases and other systemic diseases. Manually designing a valid neural network architecture for retinal vessel segmentation requires high expertise and a large workload. In order to improve the performance of vessel segmentation and reduce the workload of manually designing neural network, we propose novel approach which applies neural architecture search (NAS) to optimize an encoder-decoder architecture for retinal vessel segmentation. A modified evolutionary algorithm …
Indian Institute of Information Technology, Sri City（印度信息技术学院，斯里城）
Image to Image Translation (I2I) is a challenging computer vision problem used in numerous domains for multiple tasks. Recently, ophthalmology became one of the major fields where the application of I2I is increasing rapidly. One such application is the generation of synthetic retinal optical coherence tomographic (OCT) scans. Existing I2I methods require training of multiple models to translate images from normal scans to a specific pathology: limiting the use of these models due to their complexity. To address this issue, we propose an unsupervised multi-domain I2I network with pre-trained s…
Alzheimer's Disease (AD) is a progressive neurodegenerative disease and the leading cause of dementia. Early diagnosis is critical for patients to benefit from potential intervention and treatment. The retina has been hypothesized as a diagnostic site for AD detection owing to its anatomical connection with the brain. Developed AI models for this purpose have yet to provide a rational explanation about the decision and neither infer the stage of disease's progression. Along this direction, we propose a novel model-agnostic explainable-AI framework, called Granular Neuron-level Explainer (LAVA)…
Robust forecasting of the future anatomical changes inflicted by an ongoing disease is an extremely challenging task that is out of grasp even for experienced healthcare professionals. Such a capability, however, is of great importance since it can improve patient management by providing information on the speed of disease progression already at the admission stage, or it can enrich the clinical trials with fast progressors and avoid the need for control arms by the means of digital twins. In this work, we develop a deep learning method that models the evolution of age-related disease by proce…
Vessel segmentation in fundus is a key diagnostic capability in ophthalmology, and there are various challenges remained in this essential task. Early approaches indicate that it is often difficult to obtain desirable segmentation performance on thin vessels and boundary areas due to the imbalance of vessel pixels with different thickness levels. In this paper, we propose a novel two-stream Meticulous-Processing Network (MP-Net) for tackling this problem. To pay more attention to the thin vessels and boundary areas, we firstly propose an efficient hierarchical model automatically stratifies th…
Technische Universität Kaiserslautern（凯泽斯劳滕工业大学）；German Research Center for Artificial Intelligence GmbH (DFKI)（德国人工智能研究中心）；Opthalmology Clinic（眼科诊所）；National University of Science and Technology (NUST)（国立科技大学）；National Center of Artificial Intelligence（国家人工智能中心）；Smart Data and Knowledge Services（智能数据与知识服务部）
Scarcity of large publicly available retinal fundus image datasets for automated glaucoma detection has been the bottleneck for successful application of artificial intelligence towards practical Computer-Aided Diagnosis (CAD). A few small datasets that are available for research community usually suffer from impractical image capturing conditions and stringent inclusion criteria. These shortcomings in already limited choice of existing datasets make it challenging to mature a CAD system so that it can perform in real-world environment. In this paper we present a large publicly available retin…
University of Rostock（罗斯托克大学）；Rostock University Medical Center（罗斯托克大学医学中心）
Advances in optical coherence tomography (OCT) have enabled noninvasive imaging of substructures of the human retina with high spatial resolution. OCT examinations are now a standard procedure in clinics and an integral part of ophthalmic research. The interpretation of the OCT helps ophthalmologists understand the impact of various retinal and systemic diseases on the structure of the retina in a way not previously possible. In the early stages of retinal diseases, however, the identification and analysis of small and localized substructural changes in the retina remains a challenge. We prese…
Laser Doppler holography is a planar blood flow imaging technique recently introduced in ophthalmology to image human retinal and choroidal blood flow non-invasively. Here we present a digital method based on the Doppler spectrum asymmetry that reveals the local direction of blood flow with respect to the optical axis in out-of-plane vessels. This directional information is overlaid on standard grayscale blood flow images to depict flow moving towards the camera in red and flow moving away from the camera in blue, as in ultrasound color Doppler imaging. We show that thanks to the strong contri…
Deep Learning for Ophthalmology: The State-of-the-Art and Future Trends
German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心（DFKI））；International Max Planck Research School for Intelligent Systems (IMPRS-IS)（国际马克斯·普朗克智能系统研究院（IMPRS-IS））；University of Stuttgart（斯图加特大学）；University of Arkansas（阿肯色大学）；Oldenburg University（奥尔登堡大学）
本文综述深度学习在糖尿病视网膜病变、青光眼等眼科疾病诊断与治疗中的前沿应用、主流架构及临床落地挑战，并展望多模态 AI 眼保健的发展方向。
VARPA Research Group, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña（拉科鲁尼亚大学生物医学研究所（INIBIC）VARPA研究组）；Centro de Investigación CITIC, Universidade da Coruña（拉科鲁尼亚大学CITIC研究中心）
In ophthalmology, the study of the retinal microcirculation is a key issue in the analysis of many ocular and systemic diseases, like hypertension or diabetes. This motivates the research on improving the retinal vasculature segmentation. Nowadays, Fully Convolutional Neural Networks (FCNs) usually represent the most successful approach to image segmentation. However, the success of these models is conditioned by an adequate selection and adaptation of the architectures and techniques used, as well as the availability of a large amount of annotated data. These two issues become specially relev…
Sun Yat-sen University（中山大学）；Baidu Inc.（百度公司）；Agency for Science, Technology and Research（新加坡科技研究局）；CONICET（阿根廷国家科学技术研究委员会）；UNICEN（阿根廷中央国立大学）；Medical University of Vienna（维也纳医科大学）；VUNO Inc.（VUNO公司）；Tencent（腾讯）
With the rapid development of artificial intelligence (AI) in medical image processing, deep learning in color fundus photography (CFP) analysis is also evolving. Although there are some open-source, labeled datasets of CFPs in the ophthalmology community, large-scale datasets for screening only have labels of disease categories, and datasets with annotations of fundus structures are usually small in size. In addition, labeling standards are not uniform across datasets, and there is no clear information on the acquisition device. Here we release a multi-annotation, multi-quality, and multi-dev…
Polar-Net: A Clinical-Friendly Model for Alzheimer's Disease Detection in OCTA Images
Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences（中国科学院宁波材料技术与工程研究所慈溪生物医学工程研究所）；Cixi Biomedical Research Institute, Wenzhou Medical University（温州医科大学慈溪生物医学研究院）；School of Future Technology, South China University of Technology（华南理工大学未来技术学院）；Institute of High-Performance Computing, Agency for Science, Technology and Research（新加坡科技研究局高性能计算研究所）；Department of Computer Science, Southern University of Science and Technology（南方科技大学计算机科学与工程系）；Department of Eye and Vision Science, University of Liverpool（利物浦大学眼与视觉科学系）；Department of Computer Science, Edge Hill University（埃奇希尔大学计算机科学系）；Pazhou Lab（琶洲实验室）
OCTolyzer: Fully automatic toolkit for segmentation and feature extracting in optical coherence tomography and scanning laser ophthalmoscopy data
University of Edinburgh（爱丁堡大学）；Institute for Regeneration and Repair（再生与修复研究所）；Glasgow Caledonian University（格拉斯哥卡利多尼亚大学）；British Heart Foundation Centre for Cardiovascular Science（英国心脏基金会心血管科学中心）；Clinical Research Facility and Imaging（临床研究设施与影像中心）；Centre for Clinical Brain Sciences（临床脑科学中心）；School of Informatics（信息学院）；Institute for Adaptive and Neural Computation（自适应与神经计算研究所）；School of Mathematics（数学学院）
Domain-specific augmentations with resolution agnostic self-attention mechanism improves choroid segmentation in optical coherence tomography images
School of Mathematics, University of Edinburgh（爱丁堡大学数学学院）；Institute for Regeneration and Repair, University of Edinburgh（爱丁堡大学再生与修复研究所）；School of Informatics, University of Edinburgh（爱丁堡大学信息学院）；Centre for Medical Informatics, University of Edinburgh（爱丁堡大学医学信息学中心）；Clinical Research Facility and Imaging, University of Edinburgh（爱丁堡大学临床研究与影像中心）；Department of Vision Sciences, Glasgow Caledonian University（格拉斯哥卡利多尼安大学视觉科学系）；British Heart Foundation Centre for Cardiovascular Science, University of Edinburgh（爱丁堡大学英国心脏基金会心血管科学中心）；Centre for Clinical Brain Sciences, University of Edinburgh（爱丁堡大学临床脑科学中心）
West Virginia University（西弗吉尼亚大学）；Rockefeller Neuroscience Institute（洛克菲勒神经科学研究所）；Georgia Institute of Technology（佐治亚理工学院）；Twentieth Century Fox（二十世纪福克斯公司）；Starfleet Academy（星际舰队学院）
In this paper, we design a Generative Adversarial Network (GAN)-based solution for super-resolution and segmentation of optical coherence tomography (OCT) scans of the retinal layers. OCT has been identified as a non-invasive and inexpensive modality of imaging to discover potential biomarkers for the diagnosis and progress determination of neurodegenerative diseases, such as Alzheimer's Disease (AD). Current hypotheses presume the thickness of the retinal layers, which are analyzable within OCT scans, can be effective biomarkers. As a logical first step, this work concentrates on the challeng…
Vessel segmentation of retinal images is a key diagnostic capability in ophthalmology. This problem faces several challenges including low contrast, variable vessel size and thickness, and presence of interfering pathology such as micro-aneurysms and hemorrhages. Early approaches addressing this problem employed hand-crafted filters to capture vessel structures, accompanied by morphological post-processing. More recently, deep learning techniques have been employed with significantly enhanced segmentation accuracy. We propose a novel domain enriched deep network that consists of two components…
A General Bézier Tree Encoding Counterfactual Framework for Retinal-Vessel-Mediated Disease Analysis
Department of Electronic and Electrical Engineering（电子与电气工程系）；School of Data Science（数据科学学院）；Research Institute of Electrical Communication（电气通信研究所）；J. Crayton Pruitt Family Department of Biomedical Engineering（姜·克雷顿·普瑞特家庭生物医学工程系）
Benchmarking Ophthalmology Foundation Models for Clinically Significant Age Macular Degeneration Detection
Faculty of Biomedical Engineering, Technion-IIT（技术学院生物医学工程系）；Taub Faculty of Computer Science, Technion-IIT（技术学院计算机科学系）；Faculty of Mathematics, Technion-IIT（技术学院数学系）；Department of Ophthalmology, Hillel Yaffe Medical Center（希勒尔·亚法医疗中心眼科部）；The Ruth and Rappaport Faculty of Medicine, Technion-IIT（技术学院医学院）；Ophthalmology Department, São Paulo Federal University（圣保罗联邦大学眼科部）；Medical Engineering and Science, Massachusetts Institute of Technology（麻省理工学院医学工程与科学系）；The Adelson School of Medicine, Ariel University（阿里尔大学阿德勒医学学校）
University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心）；Indiana University-Purdue University（印第安纳大学-普渡大学）
Diabetes Mellitus (DM) can lead to significant microvasculature disruptions that eventually causes diabetic retinopathy (DR), or complications in the eye due to diabetes. If left unchecked, this disease can increase over time and eventually cause complete vision loss. The general method to detect such optical developments is through examining the vessels, optic nerve head, microaneurysms, haemorrhage, exudates, etc. from retinal images. Ultimately this is limited by the number of experienced ophthalmologists and the vastly growing number of DM cases. To enable earlier and efficient DR diagnosi…
Isik University（伊希克大学）；Istanbul Technical University（伊斯坦布尔技术大学）
Retinal optical coherence tomography (OCT) and optical coherence tomography angiography (OCTA) are promising tools for the (early) diagnosis of Alzheimer's disease (AD). These non-invasive imaging techniques are cost-effective and more accessible than alternative neuroimaging tools. However, interpreting and classifying multi-slice scans produced by OCT devices is time-consuming and challenging even for trained practitioners. There are surveys on machine learning and deep learning approaches concerning the automated analysis of OCT scans for various diseases such as glaucoma. However, the curr…
University of Science and Technology of China（中国科学技术大学）；Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences（中国科学院苏州生物医学工程技术研究所）；Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences（中国科学院脑科学与智能技术卓越创新中心）；the Third People’s Hospital of Changzhou（常州市第三人民医院）
Fluorescein angiography can provide a map of retinal vascular structure and function, which is commonly used in ophthalmology diagnosis, however, this imaging modality may pose risks of harm to the patients. To help physicians reduce the potential risks of diagnosis, an image translation method is adopted. In this work, we proposed a conditional generative adversarial network(GAN) - based method to directly learn the mapping relationship between structure fundus images and fundus fluorescence angiography images. Moreover, local saliency maps, which define each pixel's importance, are used to d…
APTOS-2024 challenge report: Generation of synthetic 3D OCT images from fundus photographs
The Hong Kong Polytechnic University（香港理工大学）；Rangsit University（兰实大学）；Rajavithi Hospital（拉差维提医院）；Monash University（莫纳什大学）；Nanjing University of Science and Technology（南京理工大学）；Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局高性能计算研究院）；Mayo Clinic（梅奥诊所）；China Medical University（中国医科大学）；Northeastern University（东北大学）；Henan Kaifeng College of Science Technology and Communication（河南开封科技传媒学院）；University of Electronic Science and Technology of China（电子科技大学）；Centre for Eye and Vision Research (CEVR)（眼科与视觉研究中心）
FusionFM: Fusing Eye-specific Foundational Models for Optimized Ophthalmic Diagnosis
Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore（新加坡国立大学 Yong Loo Lin 医学院眼科系）；Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore, Singapore（新加坡国立大学 Yong Loo Lin 医学院创新与精准眼科健康中心）；Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore（新加坡眼科研究院）；Ophthalmology and Visual Science Academic Clinical Program, Duke-NUS Medical School, Singapore, Singapore（杜克-国立新加坡大学医学学校眼科与视觉科学学术临床项目）；Centre for Medical Image Computing, University College London, London, United Kingdom（伦敦大学学院医学图像计算中心）；Joint Shantou International Eye Center, Shantou University and the Chinese University of Hong Kong, Shantou, China（汕尾国际眼科中心，汕尾大学及香港中文大学）；Department of Ophthalmology, Stadtspital Zürich, Zurich, Switzerland（苏黎世州立医院眼科部）；Spross Research Institute, Zurich, Switzerland（苏黎世 Spross 研究院）；Institute of High Performance Computing, A*STAR, Singapore（新加坡 A*STAR 高性能计算研究院）；NIHR Biomedical Research Centre, Moorfields Eye Hospital NHS Foundation Trust, London, United Kingdom（英国国家健康服务基金会 Moorfields 眼科医院生物医学研究中心）；Institute of Ophthalmology, University College London, London, United Kingdom（伦敦大学学院眼科研究院）
