In ophthalmology, early fundus screening is an economic and effective way to prevent blindness caused by ophthalmic diseases. Clinically, due to the lack of medical resources, manual diagnosis is time-consuming and may delay the condition. With the development of deep learning, some researches on ophthalmic diseases have achieved good results, however, most of them are just based on one disease. During fundus screening, ophthalmologists usually give diagnoses of multi-disease on binocular fundus image, so we release a dataset with 8 diseases to meet the real medical scene, which contains 10,000 fundus images from both eyes of 5,000 patients. We did some benchmark experiments on it through some state-of-the-art deep neural networks. We found simply increasing the scale of network cannot bring good results for multi-disease classification, and a well-structured feature fusion method combines characteristics of multi-disease is needed. Through this work, we hope to advance the research of related fields.
TransFair: Transferring Fairness from Ocular Disease Classification to Progression Prediction
School of Computing and Informatics, University of Louisiana at Lafayette(路易斯安那大学拉斐特分校计算与信息学院);Informatics Research Institute, University of Louisiana at Lafayette(路易斯安那大学拉斐特分校信息学研究所);College of Engineering and Computer Science, Florida Atlantic University(佛罗里达大西洋大学工程与计算机科学学院);Harvard Medical School(哈佛医学院)
Pathology Context Recalibration Network for Ocular Disease Recognition
Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering(可信自主系统研究院和计算机科学与工程系);Southern University of Science and Technology(南方科技大学);Tomey Corporation(Tomey公司);Department of Computer Science and Engineering(计算机科学与工程系);School of Computer Science(计算机科学学院)
Insight: A Multi-Modal Diagnostic Pipeline using LLMs for Ocular Surface Disease Diagnosis
Clinical Research Center, University of California, Berkeley(加州大学伯克利分校临床研究中心);University of California, Berkeley(加州大学伯克利分校);California Institute of Technology(加州理工学院);University of California, Davis(加州大学戴维斯分校);University of Hong Kong(香港大学)
Ocular Diseases Diagnosis in Fundus Images using a Deep Learning: Approaches, tools and Performance evaluation
ESIEE-Paris, University Paris-Est Marne-la-Vallée(巴黎东马恩拉瓦莱大学ESIEE巴黎);Faculty of medicine, University of Monastir(莫纳斯提尔大学医学院);ISITCom Hammam-Sousse, University of Sousse(苏斯大学哈马姆苏斯高等信息与通信技术学院)
AgriDoctor: A Multimodal Intelligent Assistant for Agriculture
State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
CDNet: Contrastive Disentangled Network for Fine-Grained Image Categorization of Ocular B-Scan Ultrasound
Hangzhou Dianzi University(杭州电子科技大学);the Second Affiliated Hospital of Zhejiang University(浙江大学医学院附属第二医院);Waseda University(早稻田大学);Communication University of Zhejiang(浙江传媒学院)
Is an Ultra Large Natural Image-Based Foundation Model Superior to a Retina-Specific Model for Detecting Ocular and Systemic Diseases?
National University of Singapore(新加坡国立大学);Northeastern University(东北大学);University College London(伦敦大学学院);NIHR Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust(莫菲尔德眼科医院 NHS 基金会信托 NIHR 生物医学研究中心);Singapore Eye Research Institute, Singapore National Eye Centre(新加坡眼科研究所,新加坡国家眼科中心);Institute of High-Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高性能计算研究所);The Chinese University of Hong Kong(香港中文大学);Stadtspital Zürich(苏黎世市立医院);Spross Research Institute(斯普罗斯研究所);Semmelweis University(塞梅尔维斯大学);Shantou University(汕头大学);Shantou University Medical College(汕头大学医学院)
Are Traditional Deep Learning Model Approaches as Effective as a Retinal-Specific Foundation Model for Ocular and Systemic Disease Detection?
National University of Singapore(新加坡国立大学);Yong Loo Lin School of Medicine(杨潞龄医学院);Centre for Innovation and Precision Eye Health(创新与精准眼健康中心);Institute of High-Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高性能计算研究所);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Centre(新加坡国家眼科中心);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Saw Swee Hock School of Public Health(苏瑞福公共卫生学院)
Generalist versus Specialist Vision Foundation Models for Ocular Disease and Oculomics
Institute of Ophthalmology, University College London(伦敦大学学院眼科研究所);Hawkes Institute, University College London(伦敦大学学院霍克斯研究所);NIHR Biomedical Research Centre at Moorfields Eye Hospital NHS Foundation Trust(莫菲尔德眼科医院 NHS 基金会信托 NIHR 生物医学研究中心);Yong Loo Lin School of Medicine, National University of Singapore(新加坡国立大学杨潞龄医学院);Centre for Innovation and Precision Eye Health, Yong Loo Lin School of Medicine, National University of Singapore(新加坡国立大学杨潞龄医学院创新与精准眼健康中心);Singapore Eye Research Institute, Singapore National Eye Centre(新加坡国家眼科中心新加坡眼科研究所);Chinese University of Hong Kong(香港中文大学);Shanghai Jiao Tong University(上海交通大学);MOE Key Laboratory of AI, School of Electronic, Information, and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院教育部人工智能重点实验室);Stadtspital Zürich(苏黎世市立医院);Spross Research Institute(斯普罗斯研究所);Tsinghua Medicine, Tsinghua University(清华大学清华医学);Beijing Visual Science and Translational Eye Research Institute, Beijing Tsinghua Changgung Hospital(北京清华长庚医院北京视觉科学与转化眼科研究所);University College London(伦敦大学学院)
An integrated language-vision foundation model for conversational diagnostics and triaging in primary eye care
Singapore Eye Research Institute, Singapore National Eye Centre(新加坡眼科研究所,新加坡国家眼科中心);Institute of High Performance Computing, Agency of Science, Technology and Research(高性能计算研究所,新加坡科技研究局);University of Pennsylvania(宾夕法尼亚大学);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Columbia University(哥伦比亚大学);National University of Singapore(新加坡国立大学);Chang Gung Memorial Hospital(长庚纪念医院);Chang Gung University(长庚大学);Shanghai Eye Disease Prevention & Treatment Center, Shanghai Eye Hospital(上海市眼病防治中心,上海市眼医院)
HyCARD-Net: A Synergistic Hybrid Intelligence Framework for Cardiovascular Disease Diagnosis
Faculty of Information Science and Technology(信息科学与技术学院);American International University–Bangladesh(美国国际大学-孟加拉国);School of Automotive Engineering(汽车工程学院);Chengdu Industry and Trade College(成都行业贸易学院);Faculty of Education(教育学院);Shinawatra University(辛纳瓦特大学);Tilburg School of Social and Behavioral Sciences(蒂尔堡社会与行为科学学院);Tilburg University(蒂尔堡大学)
A Graph-Augmented knowledge Distillation based Dual-Stream Vision Transformer with Region-Aware Attention for Gastrointestinal Disease Classification with Explainable AI
Department of Computer Science and Engineering(计算机科学与工程系)
A New Screening Method for COVID-19 based on Ocular Feature Recognition by Machine Learning Tools
School of Data Science, Fudan University(复旦大学数据科学学院);School of Computer Science, Fudan University(复旦大学计算机科学学院);Shanghai Public Health Clinical Center, Fudan University(复旦大学附属公共卫生临床中心);AIMOMICS (BVI) Holdings Limited(AIMOMICS(BVI)控股有限公司)
Harnessing the power of longitudinal medical imaging for eye disease prognosis using Transformer-based sequence modeling
Weill Cornell Medicine(威尔康奈尔医学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Washington University School of Medicine(华盛顿大学医学院);Columbia University(哥伦比亚大学);National Eye Institute(国家眼科研究所);National Institutes of Health (NIH)(美国国立卫生研究院);National Center for Biotechnology Information (NCBI)(国家生物技术信息中心);National Library of Medicine (NLM)(国家医学图书馆)
Intelligent Pathological Diagnosis of Gestational Trophoblastic Diseases via Visual-Language Deep Learning Model
Tsinghua University(清华大学);Third Affiliated Hospital of Zhengzhou University(郑州大学第三附属医院);The First Affiliated Hospital of Zhengzhou University(郑州大学第一附属医院);Luoyang Maternal and Child Health Care Hospital(洛阳市妇幼保健院);Women and Infants Hospital of Zhengzhou(郑州市妇幼保健院);Xinmi Maternal and Child Health Care Hospital(新密市妇幼保健院);China Academy of Information and Communications Technology(中国信息通信研究院);Anyang Maternal and Child Health Care Hospital(安阳市妇幼保健院);Suixian Maternal and Child Health Care Hospital(睢县妇幼保健院);Donghua University(东华大学)
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysis
The Hong Kong Polytechnic University(香港理工大学);Swiss Federal Institute of Technology Lausanne (EPFL)(洛桑联邦理工学院);Clemson University(克莱姆森大学);Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital(澳大利亚眼科研究中心,皇家维多利亚眼耳医院);Zhejiang University(浙江大学);Bright Eye Hospital(亮睛眼科医院);Guangdong Academy of Medical Sciences, Guangdong Provincial People's Hospital(广东省医学科学院,广东省人民医院);Capital Medical University(首都医科大学);Beijing Tongren Hospital(北京同仁医院);Centre for Eye and Vision Research (CEVR)(眼科与视觉研究中心)
BAAI Cardiac Agent: An intelligent multimodal agent for automated reasoning and diagnosis of cardiovascular diseases from cardiac magnetic resonance imaging
Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);Department of Radiology, Beijing Anzhen Hospital, Beijing Institute of Heart, Lung & Vascular Diseases, Capital Medical University(首都医科大学附属北京安贞医院放射科,北京市心肺血管疾病研究所);Department of MR, the First Affiliated Hospital, Henan Medical University(河南医科大学第一附属医院磁共振科);Department of Cardiology, Clinical Center for Coronary Heart Disease, Beijing Institute of Heart, Lung and Blood Vessel Disease, Beijing Anzhen Hospital, Capital Medical University(首都医科大学附属北京安贞医院心内科,冠心病临床中心,北京市心肺血管疾病研究所);Department of Cardiac Surgery, Beijing Anzhen Hospital, Institute of Heart, Lung and Vascular Diseases, Capital Medical University(首都医科大学附属北京安贞医院心脏外科,心肺血管疾病研究所)
Adaptive Multiscale Retinal Diagnosis: A Hybrid Trio-Model Approach for Comprehensive Fundus Multi-Disease Detection Leveraging Transfer Learning and Siamese Networks
Information-driven Fusion of Pathology Foundation Models for Enhanced Disease Characterization
Case Western Reserve University(凯斯西储大学);Department of Biomedical Engineering(生物医学工程系);Cleveland Clinic(克利夫兰诊所);Department of Pathology(病理学系);Emory University(埃默里大学);Department of Pediatrics(儿科学系);Louis Stokes VA Cleveland Medical Center(路易斯·斯托克斯退伍军人医疗中心)
Subspecialty-Specific Foundation Model for Intelligent Gastrointestinal Pathology
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Zhongnan Hospital of Wuhan University(武汉大学中南医院);Fuzhou University Affiliated Provincial Hospital(福州大学附属省立医院);Liuzhou People's Hospital Affiliated to Guangxi Medical University(广西医科大学附属柳州市人民医院);The Second Affiliated Hospital of Southern University of Science and Technology(南方科技大学第二附属医院);Shenzhen Zhengjingda Instrument Co., Ltd.(深圳正景达仪器有限公司);Chongqing University Affiliated Three Gorges Hospital(重庆大学附属三峡医院);Shenzhen Shengqiang Technology Co., Ltd.(深圳盛强科技有限公司);Longgang Central Hospital of Shenzhen(深圳市龙岗中心医院);Ningbo Clinical Pathology Diagnosis Center(宁波市临床病理诊断中心)