Clinical diagnosis is critical in medical practice, typically requiring a continuous and evolving process that includes primary diagnosis, differential diagnosis, and final diagnosis. However, most existing clinical diagnostic tasks are single-step processes, which does not align with the complex multi-step diagnostic procedures found in real-world clinical settings. In this paper, we propose a Chinese clinical diagnostic benchmark, called MSDiagnosis. This benchmark consists of 2,225 cases from 12 departments, covering tasks such as primary diagnosis, differential diagnosis, and final diagnosis. Additionally, we propose a novel and effective framework. This framework combines forward inference, backward inference, reflection, and refinement, enabling the large language model to self-evaluate and adjust its diagnostic results. To this end, we test open-source models, closed-source models, and our proposed framework.The experimental results demonstrate the effectiveness of the proposed method. We also provide a comprehensive experimental analysis and suggest future research directions for this task.
Beyond Uncertainty Reduction: Calibrated Planning for Interactive Diagnosis
Lanzhou University(兰州大学);Hunan University(湖南大学);National University of Singapore(新加坡国立大学);City University of Hong Kong(香港城市大学);The Ohio State University(俄亥俄州立大学)
MentalSeek-Dx: Towards Progressive Hypothetico-Deductive Reasoning for Real-world Psychiatric Diagnosis
School of Computer Science Chongqing University(重庆大学计算机学院);MAIS Institute of Automation Chinese Academy of Sciences(中国科学院自动化研究所MAIS研究所);The First Affiliated Hospital of Chongqing Medical University(重庆医科大学第一附属医院)
Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions
School of Biomedical Engineering, Tsinghua University(清华大学生物医学工程学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Hepato-Pancreato-Biliary Center, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University(清华大学临床医学院北京清华长庚医院肝胆胰中心);School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院);College of Electronic Information Engineering, Tongji University(同济大学电子与信息工程学院)
Knowledge-Augmented Multimodal Clinical Rationale Generation for Disease Diagnosis with Small Language Models
Hong Kong Baptist University(香港 Baptist 大学);Shanxi University(山西大学);Shanghai Institute for Advanced Study of Zhejiang University(浙江大学上海先进研究院);Hong Kong University of Science and Technology(香港科技大学);The University of Manchester(曼彻斯特大学)
Reverse Physician-AI Relationship: Full-process Clinical Diagnosis Driven by a Large Language Model
State Key Laboratory of AI Safety, Institute of Computing Technology, CAS(人工智能安全国家重点实验室,计算技术研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Peking University Third Hospital(北京大学第三医院)
Same Patient, Different Words, Different Diagnosis? Evaluating Semantic Stability in Clinical LLMs
Department of Computer Science and Engineering, College of Engineering, Qatar University(卡塔尔大学计算机科学与工程系);College of Science and Engineering, Hamad Bin Khalifa University (HBKU)(哈马德·本·卡伊夫大学(HBKU)理学院);Primary Health Care Corporation (PHCC)(初级卫生保健公司);Birmingham City University(伯明翰城市大学)
Auto-US: An Ultrasound Video Diagnosis Agent Using Video Classification Framework and LLMs
The Anhui Provincial International Joint Research Center for Advanced Technology in Medical Imaging(安徽省级国际联合先进技术医学影像研究中心);Anhui University(安徽大学);School of First Clinical Medicine(第一临床医学院);Anhui University of Science and Technology(安徽理工大学);School of Medicine(医学院);The First Hospital(第一医院)
Integrating Chain-of-Thought and Retrieval Augmented Generation Enhances Rare Disease Diagnosis from Clinical Notes
Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children's Hospital of Philadelphia(费城儿童医院雷蒙德·G·佩雷尔曼细胞与分子治疗中心);University of Pennsylvania(宾夕法尼亚大学);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)
DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models
Shanghai Jiao Tong University(上海交通大学);SII;SPIRAL Lab(SPIRAL实验室);Generative AI Research Lab (GAIR)(生成式AI研究实验室);Shanghai Chest Hospital(上海胸科医院);Beijing Anzhen Hospital, Capital Medical University(北京安贞医院,首都医科大学)
SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs' Robustness to Contradictory Evidence
Beijing University of Technology(北京工业大学);Beijing Institute of Technology(北京理工大学);China-Japan Friendship Hospital(中日友好医院);Dongbei University of Finance and Economics(东北财经大学)
MedCoRAG: Interpretable Hepatology Diagnosis via Hybrid Evidence Retrieval and Multispecialty Consensus
School of Cyber Science and Engineering, Nanjing University of Science and Technology(南京理工大学信息科学与工程学院);School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Department of Neurology, China-Japan Union Hospital of Jilin University(吉林大学中日联谊医院神经内科);Department of Anesthesiology, China-Japan Union Hospital of Jilin University(吉林大学中日联谊医院麻醉科);School of Computing, Macquarie University(麦考瑞大学计算机学院)
Improving Interactive Diagnostic Ability of a Large Language Model Agent Through Clinical Experience Learning
Research Center of Computational Life Science, Zhejiang Lab(浙江实验室计算生命科学研究中心);TransTek Medical(TransTek医疗);Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University(浙江大学医学院附属邵逸夫医院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
MACD: Multi-Agent Clinical Diagnosis with Self-Learned Knowledge for LLM
University of Science and Technology of China(中国科学技术大学);Suzhou Institute for Advanced Research, USTC(中国科学技术大学苏州高等研究院);The First Affiliated Hospital of USTC(中国科学技术大学附属第一医院)
Clinical Semantic Intelligence (CSI): Emulating the Cognitive Framework of the Expert Clinician for Comprehensive Oral Disease Diagnosis
Gilan University of Medical Sciences(加兹万大学医学科学学院);University of Göttingen(哥廷根大学);University of Tehran(德黑兰大学);Hamadan University of Technology(哈马丹技术大学);Islamic Azad University(伊斯兰 Azad 大学)
Identification of Pediatric Respiratory Diseases Using Fine-grained Diagnosis System
Zhejiang University School of Medicine(浙江大学医学院);National Clinical Research Center for Child Health(国家儿童健康与疾病临床医学研究中心);Deepwise AI Lab(深睿医疗人工智能实验室);Peking University(北京大学);The University of Hong Kong(香港大学)
AI-Powered Dermatological Diagnosis: From Interpretable Models to Clinical Implementation A Comprehensive Framework for Accessible and Trustworthy Skin Disease Detection
Department of Business Analytics/Data Science Engineering University of New Haven(商业分析/数据科学工程系 罗德岛大学);Department of Healthcare University of New Haven(医疗健康系 罗德岛大学)
MedCollab: IBIS-Guided Multi-Agent Collaboration with Hierarchical Disease Relation Chains for Clinical Diagnosis
Princeton University(普林斯顿大学);Springer Heidelberg(斯普林格海德堡);ABC Institute(ABC研究所);Rupert-Karls-University Heidelberg(海德堡鲁珀特-卡尔大学);Hangzhou Dianzi University(杭州电子科技大学);Zhejiang University(浙江大学);Children’s Hospital, Zhejiang University School of Medicine, National Clinical Research Center for Children and Adolescents’ Health and Diseases(浙江大学医学院儿童医院,国家儿童青少年健康与疾病临床研究中心)
Medical Diagnosis with Large Scale Multimodal Transformers: Leveraging Diverse Data for More Accurate Diagnosis
University Hospital Aachen(亚琛大学医院);RWTH Aachen University(亚琛工业大学);Ocumeda GmbH(Ocumeda 有限公司);RWTH Aachen(亚琛工业大学);Charité – Universitätsmedizin Berlin(柏林夏里特医学院);Freie Universität Berlin(柏林自由大学);Technical University Dresden(德累斯顿工业大学);University of Leeds(利兹大学);University Hospital Heidelberg(海德堡大学医院)
MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow
National University of Singapore(新加坡国立大学);University of Oxford(牛津大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));National University of Defense Technology(国防科技大学);The Second Affiliated Hospital Zhejiang University School of Medicine(浙江大学医学院附属第二医院)
Thinking Like a Clinician: A Cognitive AI Agent for Clinical Diagnosis via Panoramic Profiling and Adversarial Debate
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China(中国科学技术大学生物医学工程学院,生命科学与医学系);Suzhou Institute for Advanced Research, University of Science and Technology of China(中国科学技术大学苏州市先进研究机构);Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS(中国科学院智能信息处理重点实验室,计算技术研究所);Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology(江苏省多模态数字孪生技术省级重点实验室);State Key Laboratory of Precision and Intelligent Chemistry, USTC(国家精密与智能化学重点实验室,中国科学技术大学)
Empowering Medical Multi-Agents with Clinical Consultation Flow for Dynamic Diagnosis
The School of Data Science, Fudan University(复旦大学数据科学学院);Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学类脑智能科学与技术研究院);University of Cambridge(剑桥大学)
A Novel Multi-Task Model Imitating Dermatologists for Accurate Differential Diagnosis of Skin Diseases in Clinical Images
DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Hupan Lab(湖畔实验室);Beijing Normal University(北京师范大学);Sir Run Run Shaw Hospital(邵逸夫医院);The Second Affiliated Hospital Zhejiang University School of Medicine(浙江大学医学院附属第二医院);Xiangya Hospital Central South University(中南大学湘雅医院)