Are Traditional Deep Learning Model Approaches as Effective as a Retinal-Specific Foundation Model for Ocular and Systemic Disease Detection?
National University of Singapore(新加坡国立大学);Yong Loo Lin School of Medicine(杨潞龄医学院);Centre for Innovation and Precision Eye Health(创新与精准眼健康中心);Institute of High-Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高性能计算研究所);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Centre(新加坡国家眼科中心);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Saw Swee Hock School of Public Health(苏瑞福公共卫生学院)
Samantha Min Er Yew, Xiaofeng Lei, Jocelyn Hui Lin Goh, Yibing Chen, Sahana Srinivasan, Miao-li Chee, Krithi Pushpanathan, Ke Zou, Qingshan Hou, Zhi Da Soh, Can… 展开作者
Samantha Min Er Yew, Xiaofeng Lei, Jocelyn Hui Lin Goh, Yibing Chen, Sahana Srinivasan, Miao-li Chee, Krithi Pushpanathan, Ke Zou, Qingshan Hou, Zhi Da Soh, Cancan Xue, Marco Chak Yan Yu, Charumathi Sabanayagam, E Shyong Tai, Xueling Sim, Yaxing Wang, Jost B. Jonas, Vinay Nangia, Gabriel Dawei Yang, Emma Anran Ran, Carol Yim-Lui Cheung, Yangqin Feng, Jun Zhou, Rick Siow Mong Goh, Yukun Zhou, Pearse A. Keane, Yong Liu, Ching-Yu Cheng, Yih-Chung Tham
Background: RETFound, a self-supervised, retina-specific foundation model (FM), showed potential in downstream applications. However, its comparative performance with traditional deep learning (DL) models remains incompletely understood. This study aimed to evaluate RETFound against three ImageNet-pretrained supervised DL models (ResNet50, ViT-base, SwinV2) in detecting ocular and systemic diseases.
Methods: We fine-tuned/trained RETFound and three DL models on full datasets, 50%, 20%, and fixed sample sizes (400, 200, 100 images, with half comprising disease cases; for each DR severity class, 100 and 50 cases were used. Fine-tuned models were tested internally using the SEED (53,090 images) and APTOS-2019 (3,672 images) datasets and externally validated on population-based (BES, CIEMS, SP2, UKBB) and open-source datasets (ODIR-5k, PAPILA, GAMMA, IDRiD, MESSIDOR-2). Model performance was compared using area under the receiver operating characteristic curve (AUC) and Z-tests with Bonferroni correction (P<0.05/3).
Interpretation: Traditional DL models are mostly comparable to RETFound for ocular disease detection with large datasets. However, RETFound is superior in systemic disease detection with smaller datasets. These findings offer valuable insights into the respective merits and limitation of traditional models and FMs.
Smartphone-Based Test and Predictive Models for Rapid, Non-Invasive, and Point-of-Care Monitoring of Ocular and Cardiovascular Complications Related to Diabetes
oculomix: Hierarchical Sampling for Retinal-Based Systemic Disease Prediction
Institute of Ophthalmology, University College London, United Kingdom(伦敦大学学院眼科研究所);NIHR Moorfields Biomedical Research Centre, London, United Kingdom(英国 Moorfields 生物医学研究中心);University of Cologne, Faculty of Medicine, Department of Ophthalmology, Germany(科隆大学医学院眼科系);Hanyang University Guri Hospital, Guri City, South Korea(翰阳大学Guri医院)
Development of a Mobile Application for at-Home Analysis of Retinal Fundus Images
Division of Engineering Science(工程科学系);University of Toronto(多伦多大学);School of Information Technology(信息科技学院);King Mongkut’s University of Technology Thonburi(泰国科技泰伦比大学);Innovative Cognitive Computing Research Center(创新认知计算研究中心);Chinese International School of Hong Kong(香港中文国际学校)
Generalist versus Specialist Vision Foundation Models for Ocular Disease and Oculomics
Institute of Ophthalmology, University College London(伦敦大学学院眼科研究所);Hawkes Institute, University College London(伦敦大学学院霍克斯研究所);NIHR Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust(莫菲尔德眼科医院 NHS 基金会信托 NIHR 生物医学研究中心);Yong Loo Lin School of Medicine, National University of Singapore(新加坡国立大学杨潞龄医学院);Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore(新加坡国立大学杨潞龄医学院创新与精准眼健康中心);Singapore Eye Research Institute, Singapore National Eye Centre(新加坡国家眼科中心新加坡眼科研究所);Chinese University of Hong Kong(香港中文大学);Shanghai Jiao Tong University(上海交通大学);MOE Key Laboratory of AI, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院教育部人工智能重点实验室);Stadtspital Zürich(苏黎世市立医院);Spross Research Institute(斯普罗斯研究所);Tsinghua Medicine, Tsinghua University(清华大学清华医学);Beijing Visual Science and Translational Eye Research Institute, Beijing Tsinghua Changgung Hospital(北京清华长庚医院北京视觉科学与转化眼科研究所);University College London(伦敦大学学院)
CDNet: Contrastive Disentangled Network for Fine-Grained Image Categorization of Ocular B-Scan Ultrasound
Hangzhou Dianzi University(杭州电子科技大学);the Second Affiliated Hospital of Zhejiang University(浙江大学医学院附属第二医院);Waseda University(早稻田大学);Communication University of Zhejiang(浙江传媒学院)
OCTCube-M: A 3D multimodal optical coherence tomography foundation model for retinal and systemic diseases with cross-cohort and cross-device validation
Is an Ultra Large Natural Image-Based Foundation Model Superior to a Retina-Specific Model for Detecting Ocular and Systemic Diseases?
National University of Singapore(新加坡国立大学);Northeastern University(东北大学);University College London(伦敦大学学院);NIHR Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust(莫菲尔德眼科医院 NHS 基金会信托 NIHR 生物医学研究中心);Singapore Eye Research Institute, Singapore National Eye Centre(新加坡眼科研究所,新加坡国家眼科中心);Institute of High-Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高性能计算研究所);The Chinese University of Hong Kong(香港中文大学);Stadtspital Zürich(苏黎世市立医院);Spross Research Institute(斯普罗斯研究所);Semmelweis University(塞梅尔维斯大学);Shantou University(汕头大学);Shantou University Medical College(汕头大学医学院)
Retinal Lipidomics Associations as Candidate Biomarkers for Cardiovascular Health
Electronics and Computer Science, University of Southampton(索姆塞特大学电子与计算机科学系);Department of Computational Biology, Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学计算生物学系)
Overview of Deep Learning Methods for Retinal Vessel Segmentation
The Institute for Artificial Intelligence Research and Development of Serbia(塞尔维亚人工智能研发研究所);University of Novi Sad(诺维萨德大学);The Faculty of Technical Sciences(技术科学学院)
OCTDL: Optical Coherence Tomography Dataset for Image-Based Deep Learning Methods
Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大-埃尔朗根-纽伦堡大学);Ural Federal University Named after the First President of Russia B. N. Yeltsin(俄罗斯首任总统B.N.叶利钦命名的乌拉尔联邦大学);Ophthalmosurgery Clinic "Professorskaya Plus"(“Professorskaya Plus”眼科诊所);Ural State Medical University(乌拉尔国立医科大学)
TransFair: Transferring Fairness from Ocular Disease Classification to Progression Prediction
School of Computing and Informatics, University of Louisiana at Lafayette(路易斯安那大学拉斐特分校计算与信息学院);Informatics Research Institute, University of Louisiana at Lafayette(路易斯安那大学拉斐特分校信息学研究所);College of Engineering and Computer Science, Florida Atlantic University(佛罗里达大西洋大学工程与计算机科学学院);Harvard Medical School(哈佛医学院)
Nanyang Technological University(南洋理工大学);Inception Institute of Artificial Intelligence (IIAI)(起源人工智能研究院);Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所);Nanjing University of Science and Technology(南京理工大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Structure-preserving Guided Retinal Image Filtering and Its Application for Optic Disc Analysis
Cixi Institute of Biomedical Engineering, Chinese Academy of Sciences(中国科学院慈溪生物医学工程研究所);Institute for Infocomm Research, Agency for Science, Technology and Research(新加坡科技研究局资讯通信研究院);Shanghai University(上海大学)
Automated Erythrocyte Detection and Tracking for Retinal Blood Flow Quantification in Erythrocyte-Mediated Angiography
Department of Bioengineering, University of Maryland, College Park, MD 20742, USA(生物工程系,马里兰大学,学院公园,MD 20742,美国);Department of Ophthalmology and Visual Sciences, University of Maryland School of Medicine, Baltimore, MD 21201, USA(眼科学与视觉科学系,马里兰大学医学院,巴尔的摩,MD 21201,美国);Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA(电气与计算机工程系,马里兰大学,学院公园,MD 20742,美国)
BenchReAD: A systematic benchmark for retinal anomaly detection
The Center for Smart Health, School of Nursing, the Hong Kong Polytechnic University, Hong Kong, China(香港理工大学护理学院智能健康中心);School of Biomedical Engineering, Tsinghua University, Beijing, China(清华大学生物医学工程学院);Research Center for Medical AI, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China(中国科学院深圳先进技术研究院医学人工智能研究中心)
Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation
VARPA Research Group, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña(拉科鲁尼亚大学生物医学研究所(INIBIC)VARPA研究组);Centro de Investigación CITIC, Universidade da Coruña(拉科鲁尼亚大学CITIC研究中心)
The Role of AI in Early Detection of Life-Threatening Diseases: A Retinal Imaging Perspective
Naif Arab University for Security Sciences(奈伊夫阿拉伯安全科学大学);Charles Sturt University(查尔斯特大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Machine Learning Prediction of Cardiovascular Risk in Type 1 Diabetes Mellitus Using Radiomics Features from Multimodal Retinal Images
Universitat Politècnica de Catalunya (UPC)(加泰罗尼亚理工大学);Institut Clínic d´Oftalmología (ICOF)(眼科临床研究所);Hospital Clínic de Barcelona(巴塞罗那临床医院);Intelligent Data Science and Artificial Intelligence (IDEAI-UPC) Research Center(智能数据科学与人工智能研究中心);August Pi i Sunyer Biomedical Research Institute (IDIBAPS)(奥古斯特·皮伊·苏涅尔生物医学研究所);School of Medicine, Universitat de Barcelona(巴塞罗那大学医学院)
RVD: A Handheld Device-Based Fundus Video Dataset for Retinal Vessel Segmentation
The University of Queensland(昆士兰大学);University of Technology Sydney(悉尼科技大学);Australian National University(澳大利亚国立大学);University of New South Wales(新南威尔士大学);Victoria University(维多利亚大学);Deakin University(迪肯大学)
Fundus to Fluorescein Angiography Video Generation as a Retinal Generative Foundation Model
The Hong Kong Polytechnic University(香港理工大学);Swiss Federal Institute of Technology Lausanne (EPFL)(瑞士洛桑联邦理工学院);Clemson University(克莱姆森大学);University of Science and Technology of China(中国科学技术大学);Research Centre for SHARP Vision (RSCV), The Hong Kong Polytechnic University(香港理工大学SHARP视觉研究中心);Centre for Eye and Vision Research (CEVR)(眼科视觉研究中心)
Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networks
BioVessel-Net and RetinaMix: Unsupervised Retinal Vessel Segmentation from OCTA Images
University of Electronic Science and Technology of China(电子科技大学);Southern Methodist University(南方法律大学);University of Texas Southwestern Medical Center(德克萨斯西南医学中心);University Medical Center Utrecht(乌得勒支大学医学中心);Georgetown University(杰斐逊大学);Sichuan Provincial People’s Hospital(四川省级人民医院);University of Connecticut(康涅狄格大学)
A General Bézier Tree Encoding Counterfactual Framework for Retinal-Vessel-Mediated Disease Analysis
Department of Electronic and Electrical Engineering(电子与电气工程系);School of Data Science(数据科学学院);Research Institute of Electrical Communication(电气通信研究所);J. Crayton Pruitt Family Department of Biomedical Engineering(姜·克雷顿·普瑞特家庭生物医学工程系)
Automated Grading System of Retinal Arterio-venous Crossing Patterns: A Deep Learning Approach Replicating Ophthalmologist's Diagnostic Process of Arteriolosclerosis
Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations
Technical University of Munich(慕尼黑工业大学);Imperial College London(帝国理工学院);Helmholtz Zentrum Muenchen(亥姆霍兹慕尼黑中心);University of Innsbruck(因斯布鲁克大学);University of Oxford(牛津大学);Moorfields Eye Hospital NHS Foundation Trust(摩尔菲尔德眼科医院国民保健服务基金会信托);Boehringer Ingelheim Limited(勃林格殷格翰有限公司);University College London(伦敦大学学院);Cairo University(开罗大学);Watany Eye Hospital(瓦塔尼眼科医院);Heidelberg Engineering GmbH(海德堡工程有限公司);University of Zurich(苏黎世大学)