Medical practitioners are rapidly adopting generative AI solutions for clinical documentation, leading to significant time savings and reduced stress. However, evaluating the quality of AI-generated documentation is a complex and ongoing challenge. This paper presents an overview of DeepScribe's methodologies for assessing and managing note quality, focusing on various metrics and the composite "DeepScore", an overall index of quality and accuracy. These methodologies aim to enhance the quality of patient care documentation through accountability and continuous improvement.
Semantic Analysis of SNOMED CT Concept Co-occurrences in Clinical Documentation using MIMIC-IV
Informatics and Analytics, University of North Carolina Greensboro, Greensboro, NC（信息学与分析，北卡罗来纳大学格林斯伯罗分校）；Department of Computer Science, University of Nebraska Omaha, Omaha, NE（计算机科学系，内布拉斯加大学奥马哈分校）
Coding-Free and Privacy-Preserving Agentic Framework for Data-Driven Clinical Research
Infmedix, Co., Ltd.（Infmedix公司）；Department of Transdisciplinary Studies, Seoul National University（首尔国立大学跨学科研究系）；Healthcare AI Research Institute, Seoul National University Hospital（首尔国立大学医院医疗人工智能研究所）；Department of Medicine, Seoul National University College of Medicine（首尔国立大学医学院医学系）；Department of Transdisciplinary Medicine, Seoul National University Hospital（首尔国立大学医院跨学科医学系）；Department of Radiology, Massachusetts General Hospital and Harvard Medical School（麻省总医院放射科及哈佛医学院）
Berta: an open-source, modular tool for AI-enabled clinical documentation
Department of Medicine, University of Alberta, Edmonton, Alberta, Canada（阿尔伯塔大学医学系，埃德蒙顿，阿尔伯塔，加拿大）；Department of Emergency Medicine, University of Alberta, Edmonton, Alberta, Canada（阿尔伯塔大学急诊医学系，埃德蒙顿，阿尔伯塔，加拿大）；Alberta Health Services, Edmonton, Alberta, Canada（阿尔伯塔省健康服务，埃德蒙顿，阿尔伯塔，加拿大）；Alberta Machine Intelligence Institute, Edmonton, Alberta, Canada（阿尔伯塔人工智能研究所，埃德蒙顿，阿尔伯塔，加拿大）；Department of Computer Science, University of Alberta, Edmonton, Alberta, Canada（阿尔伯塔大学计算机科学系，埃德蒙顿，阿尔伯塔，加拿大）
Large language models are vulnerable to incidental information in clinical documentation and reasoning
NYU Langone Health（纽约大学朗格尼健康中心）；Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Washington University School of Medicine in St. Louis（圣路易斯华盛顿大学医学院）；University of Alabama at Birmingham Heersink School of Medicine（阿拉巴马大学伯明翰分校希尔斯金医学院）；Perelman School of Medicine at the University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）；New York University（纽约大学）
Leveraging Contextual Relatedness to Identify Suicide Documentation in Clinical Notes through Zero Shot Learning
The George Washington University（乔治华盛顿大学）；VA Medical Center, Washington, DC（华盛顿退伍军人医疗中心）；Yale School of Medicine（耶鲁大学医学院）；VA Connecticut Healthcare System（康涅狄格退伍军人医疗系统）；University of Southern California（南加州大学）
Intelligent Documentation in Medical Education: Can AI Replace Manual Case Logging?
Department of Computer Science, University of California, Davis, CA, USA（计算机科学系，加州大学戴维斯分校）；Department of Radiology, University of California, Davis, CA, USA（放射学系，加州大学戴维斯分校）
Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note Scale
Australian e-Health Research Centre, CSIRO, Australia（澳大利亚电子健康研究中心，CSIRO，澳大利亚）；National Library of Medicine, National Institutes of Health, USA（国家医学图书馆，国立卫生研究院，美国）
Evaluating Fine-Tuned LLM Model For Medical Transcription With Small Low-Resource Languages Validated Dataset
School of ICT and Industrial Management（信息通信技术与工业管理学院）；Metropolia University of Applied Sciences（Metropolia应用科学大学）；Rensselaer Polytechnic Institute（伦斯勒理工学院）
PAINT: A Framework for Multilingual Pain Representation from Medical Licensing Exams to Real-World Clinical Texts
University of Geneva（日内瓦大学）；Massachusetts Institute of Technology（麻省理工学院）；McGill University（麦吉尔大学）；Harvard Medical School（哈佛医学院）；Brigham and Women’s Hospital（布莱根妇女医院）；Harvard T.H. Chan School of Public Health（哈佛陈曾熙公共卫生学院）；Mahidol University（玛希隆大学）；Seoul National University Hospital（首尔大学医院）；National Taiwan University（国立台湾大学）；Universidade de São Paulo（圣保罗大学）；Santa Marcelina College of Medicine（圣马塞利纳医学院）；Universidad Peruana Cayetano Heredia（秘鲁卡耶塔诺埃雷迪亚大学）；HM Hospitales（HM医院集团）；St. Luke’s Medical Center College of Medicine（圣路加医疗中心医学院）；Fukushima Medical University（福岛医科大学）；Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）
Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging
University of Florida（佛罗里达大学）；Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida（佛罗里达大学医学院健康结果与生物医学信息学系）；Department of Engineering Education, Herbert Wertheim College of Engineering, University of Florida（佛罗里达大学赫伯特·韦特海姆工程学院工程教育系）；Preston A. Wells, Jr. Center for Brain Tumor Therapy, Lillian S. Wells Department of Neurosurgery, University of Florida（佛罗里达大学莉莉安·S·威尔斯神经外科系普雷斯顿·A·威尔斯脑肿瘤治疗中心）
Assessing the Quality of AI-Generated Clinical Notes: A Validated Evaluation of a Large Language Model Scribe
Suki AI；Santa Clara Valley Medical Center（圣克拉拉谷医疗中心）；Stanford University School of Medicine（斯坦福大学医学院）；Stanford Cardiovascular Institute（斯坦福心血管研究所）；Hippocratic AI；The Permanente Medical Group（永久医疗集团）
