Bridging the Knowledge-Action Gap by Evaluating LLMs in Dynamic Dental Clinical Scenarios
The Second Affiliated Hospital of Harbin Medical University(哈尔滨医科大学附属第二医院);Peking University School and Hospital of Stomatology(北京大学口腔医学院(口腔医院));Medlinker Intelligent and Digital Technology Co., Ltd(医联智数科技有限公司);The University of Queensland(昆士兰大学);Beijing Xicheng District Health Care Hospital for Mothers and Children(北京市西城区妇幼保健院)
The transition of Large Language Models (LLMs) from passive knowledge retrievers to autonomous clinical agents demands a shift in evaluation-from static accuracy to dynamic behavioral reliability. To explore this boundary in dentistry, a domain where high-quality AI advice uniquely empowers patient-participatory decision-making, we present the Standardized Clinical Management & Performance Evaluation (SCMPE) benchmark, which comprehensively assesses performance from knowledge-oriented evaluations (static objective tasks) to workflow-based simulations (multi-turn simulated patient interactions). Our analysis reveals that while models demonstrate high proficiency in static objective tasks, their performance precipitates in dynamic clinical dialogues, identifying that the primary bottleneck lies not in knowledge retention, but in the critical challenges of active information gathering and dynamic state tracking. Mapping "Guideline Adherence" versus "Decision Quality" reveals a prevalent "High Efficacy, Low Safety" risk in general models. Furthermore, we quantify the impact of Retrieval-Augmented Generation (RAG). While RAG mitigates hallucinations in static tasks, its efficacy in dynamic workflows is limited and heterogeneous, sometimes causing degradation. This underscores that external knowledge alone cannot bridge the reasoning gap without domain-adaptive pre-training. This study empirically charts the capability boundaries of dental LLMs, providing a roadmap for bridging the gap between standardized knowledge and safe, autonomous clinical practice.
OralMLLM-Bench: Evaluating Cognitive Capabilities of Multimodal Large Language Models in Dental Practice
Beijing Stomatological Hospital(北京口腔医院);School of Stomatology, Capital Medical University(首都医科大学口腔医学院);University of Minnesota(明尼苏达大学);The Hong Kong Polytechnic University(香港理工大学)
Medchain: Bridging the Gap Between LLM Agents and Clinical Practice with Interactive Sequence
The City University of Hong Kong(香港城市大学);Renmin University of China(中国人民大学);The Chinese University of Hong Kong(香港中文大学);Shenzhen University(深圳大学);National Yang Ming Chiao Tung University(阳明交通大学);Taipei Veterans General Hospital(台北荣民总医院)
ChatGPT for Shaping the Future of Dentistry: The Potential of Multi-Modal Large Language Model
State Key Laboratory of Oral Diseases & National Clinical Research Center for Oral Diseases & Department of Oral and Maxillofacial Surgery, West China Hospital of Stomatology, Sichuan University(四川大学华西口腔医院口腔疾病研究国家重点实验室、国家口腔疾病临床医学研究中心、口腔颌面外科);Department of Civil, Environmental & Construction Engineering, University of Central Florida(中佛罗里达大学土木、环境与建筑工程系);College of Transportation Engineering, University of Central Florida(中佛罗里达大学交通工程学院);School of Transportation and Logistics, Southwest Jiaotong University(西南交通大学交通运输与物流学院);C2SMART Center, Tandon School of Engineering, New York University(纽约大学坦登工程学院C2SMART中心);State Key Laboratory of Oral Diseases & National Clinical Research Center for Oral Diseases & Eastern Clinic, West China Hospital of Stomatology, Sichuan University(四川大学华西口腔医院口腔疾病研究国家重点实验室、国家口腔疾病临床医学研究中心、东院区)
Cross-Institutional Dental EHR Entity Extraction via Generative AI and Synthetic Notes
The University of Texas Health Science Center at Houston(德克萨斯大学休斯顿健康科学中心);University of California San Francisco(加利福尼亚大学旧金山分校);Willamette Dental Group(威拉米特牙科集团);Skourtes Institute(斯库特斯研究所)
Dental-TriageBench: Benchmarking Multimodal Reasoning for Hierarchical Dental Triage
School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院);Faculty of Dentistry, The University of Hong Kong(香港大学牙科学院);The Prince Philip Dental Hospital(菲利普王子牙科医院);Li Ka Shing Faculty of Medicine, The University of Hong Kong(香港大学利滋医学学院);The Hong Kong University of Science and Technology(香港科学与技术大学)
GlobalDentBench: A Multinational Benchmark for Evaluating LLM Clinical Reasoning in Dentistry with Expert Calibration
Division of Applied Oral Sciences and Community Dental Care, Faculty of Dentistry, The University of Hong Kong(香港大学牙科学院应用口腔科学与社区牙科护理系);School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院);Department of Periodontology, Shenzhen Stomatology Hospital (Pingshan) of Southern Medical University, Shenzhen, China(南方医科大学深圳口腔医院(平山)牙周科);Beijing Institute of Collaborative Innovation(北京协同创新研究院);Department of Orthodontics, Shenzhen Stomatology Hospital (Pingshan) of Southern Medical University, Shenzhen, China(南方医科大学深圳口腔医院(平山)正畸科);Shenzhen Stomatology Hospital (Pingshan) of Southern Medical University, Shenzhen, China(南方医科大学深圳口腔医院(平山));College of Future Technology, Peking University(北京大学未来技术学院);Freedom AI;New Cornerstone Science Laboratory, National Biomedical Imaging Center, State Key Laboratory of Membrane Biology, Institute of Molecular Medicine, Peking-Tsinghua Center for Life Sciences, College of Future Technology, Peking University, Beijing 100871, China(新基石科学实验室、国家生物医学成像中心、膜生物学国家重点实验室、分子医学研究院、北京大学未来技术学院、生命科学中心,北京大学,北京100871,中国);IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China(IDG/ McGovern脑科学研究院,北京大学,北京100871,中国);Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, The University of Hong Kong(香港大学牙科学院口腔颌面外科系);Shenzhen Loop Area Institute(深圳河套学院);Department of Cancer Biology, Mayo Clinic Arizona, 5777 E. Mayo Blvd., IERB-3-504A, Phoenix, Arizona, 85054, USA(梅奥诊所亚利桑那分部癌症生物学部门,5777 E. Mayo Blvd., IERB-3-504A, Phoenix, Arizona, 85054, USA);Department of Conservative Dentistry, Periodontology and Digital Dentistry, LMU University Hospital, LMU Munich, Munich, Germany(慕尼黑大学医院保守牙科、牙周病学和数字牙科部门,慕尼黑,德国,慕尼黑大学);Division of Periodontology & Implant Dentistry, Faculty of Dentistry, The University of Hong Kong, Hong Kong, SAR, China(香港大学牙科学院牙周病学与种植牙科系,香港,中国)
OralAgent: Integrating Reasoning, Tools, and Knowledge for Interactive Dental Image Analysis
Faculty of Dentistry, the University of Hongkong, Hong Kong SAR, China(香港大学牙科学院,中国香港特别行政区);Department of Electrical and Computer Engineering, University of Pittsburgh, Pittsburgh, PA, USA(匹兹堡大学电气与计算机工程系,美国宾夕法尼亚州匹兹堡);Shenzhen University, China(深圳大学,中国);Department of Craniomaxillofacial Surgery, Shanghai Ninth People’s Hospital, China(上海第九人民医院口腔颌面外科部,中国);Nanyang technological University, Singapore(南洋理工大学,新加坡);School of Biomedical Engineering, Southern Medical University, China(南方医科大学生物医学工程学院,中国);Singapore University of Technology and Design, Singapore(新加坡科技设计大学,新加坡);University of Auckland, new zealand(奥克兰大学,新西兰);Shanghai Artificial Intelligence Laboratory , China(上海人工智能实验室,中国)
Cross-Lingual Mental Health Ontologies for Indian Languages: Bridging Patient Expression and Clinical Understanding through Explainable AI and Human-in-the-Loop Validation
University of Florida(佛罗里达大学);University of Kansas(堪萨斯大学);University of Maryland(马里兰大学);IIT Kharagpur(印度理工学院卡拉格普尔分校)
Self-Prompting Small Language Models for Privacy-Sensitive Clinical Information Extraction
McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston(德克萨斯大学健康科学中心休斯顿分校麦克威廉斯生物医学信息学学院);School of Public Health, The University of Texas Health Science Center at Houston(德克萨斯大学健康科学中心休斯顿分校公共卫生学院);School of Dentistry, The University of Texas Health Science Center at Houston(德克萨斯大学健康科学中心休斯顿分校牙科学院);Willamette Dental and Skourtes Institute(威廉特牙科与斯库尔特斯研究所)
Adapting Event Extractors to Medical Data: Bridging the Covariate Shift
Language Technologies Institute, Carnegie Mellon University(卡内基梅隆大学语言技术研究所);Human-Computer Interaction Institute, Carnegie Mellon University(卡内基梅隆大学人机交互研究所)
LingShu: A Large-Scale Symptom-Centric Contextualized Knowledge Graph Bridging Traditional Chinese Medicine and Modern Biomedicine
Beijing Jiaotong University(北京交通大学);Hubei Provincial Hospital of Traditional Chinese Medicine(湖北省中医院);Hubei University of Chinese Medicine(湖北中医药大学);Hubei Province Academy of Traditional Chinese Medicine(湖北省中医药研究院);China Academy of Chinese Medical Sciences(中国中医科学院);Xiyuan Hospital(西苑医院);National Clinical Research Center for Chinese Medicine Cardiology(国家中医心血管病临床医学研究中心);Hubei Provincial Clinical Research Center for Acupuncture and Moxibustion in Obesity Treatment(湖北省肥胖病针灸临床研究中心);Hubei Shizhen Laboratory(湖北时珍实验室);Tianjin Ta(天津(此处原文未完整,按原文提取))