Stronger Baseline Models -- A Key Requirement for Aligning Machine Learning Research with Clinical Utility
University of Minnesota(明尼苏达大学);Medical College of Wisconsin(威斯康星医学院);Bud and Sue Selig Hub for Surgical Data Science, Medical College of Wisconsin(威斯康星医学院 Bud 和 Sue Selig 外科数据科学中心);Department of Surgery, Medical College of Wisconsin(威斯康星医学院外科系)
Nathan Wolfrath, Joel Wolfrath, Hengrui Hu, Anjishnu Banerjee, Anai N. Kothari
Machine Learning (ML) research has increased substantially in recent years, due to the success of predictive modeling across diverse application domains. However, well-known barriers exist when attempting to deploy ML models in high-stakes, clinical settings, including lack of model transparency (or the inability to audit the inference process), large training data requirements with siloed data sources, and complicated metrics for measuring model utility. In this work, we show empirically that including stronger baseline models in healthcare ML evaluations has important downstream effects that aid practitioners in addressing these challenges. Through a series of case studies, we find that the common practice of omitting baselines or comparing against a weak baseline model (e.g. a linear model with no optimization) obscures the value of ML methods proposed in the research literature. Using these insights, we propose some best practices that will enable practitioners to more effectively study and deploy ML models in clinical settings.
Aligning Subjective Ratings in Clinical Decision Making
Fraunhofer IAIS(弗劳恩霍夫智能分析与信息系统研究所);Fraunhofer Cluster of Excellence Immune-Mediated Diseases CIMD(弗劳恩霍夫免疫介导疾病卓越集群);Fraunhofer Center for Machine Learning(弗劳恩霍夫机器学习中心);Fraunhofer IME-TMP(弗劳恩霍夫分子生物学与应用生态学研究所转化医学与药理学分部)
ALPEC: A Comprehensive Evaluation Framework and Dataset for Machine Learning-Based Arousal Detection in Clinical Practice
University of Tübingen(蒂宾根大学);IT-Designers Gruppe(IT-Designers集团);Aalen University of Applied Sciences(阿伦应用技术大学);Klinikum Esslingen(埃斯林根医院);Technical University of Munich(慕尼黑工业大学)
Harvard Medical School(哈佛医学院);Harvard College(哈佛学院);Broad Institute of MIT and Harvard(麻省理工学院和哈佛大学布罗德研究所);Harvard Data Science Initiative(哈佛数据科学研究院);Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University(哈佛大学肯普纳自然与人工智能研究学院)
Improving Clinical Dataset Condensation with Mode Connectivity-based Trajectory Surrogates
Institute of Biomedical Engineering, University of Oxford, UK(生物医学工程研究所,牛津大学,英国);GlaxoSmithKline, London, UK(葛兰素史克,伦敦,英国);Nuffield Department of Primary Care Health Sciences, University of Oxford, UK(初级保健健康科学尼弗尔部门,牛津大学,英国);Oxford-Suzhou Institute of Advanced Research (OSCAR), Suzhou, China(牛津-苏州先进研究所(OSCAR),苏州,中国)
Temporal Gaussian Copula For Clinical Multivariate Time Series Data Imputation
Chongqing Institute of Green and Intelligent Technology, CAS(中国科学院重庆绿色智能技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Singapore Management University(新加坡管理大学);Southwest University(西南大学)
Bridging AI and Clinical Practice: Integrating Automated Sleep Scoring Algorithm with Uncertainty-Guided Physician Review
University of Bern(伯尔尼大学);University of Applied Sciences and Arts of Southern Switzerland(瑞士南部应用科学与艺术大学);Inselspital, Bern University Hospital(伯尔尼大学医院);Ohio Sleep Medicine Institute(俄亥俄睡眠医学研究所)