arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.12116cs.LGcs.CY
收藏

更强的基线模型——使机器学习研究与临床效用对齐的一项关键要求

Stronger Baseline Models -- A Key Requirement for Aligning Machine Learning Research with Clinical Utility

University of Minnesota(明尼苏达大学);Medical College of Wisconsin(威斯康星医学院);Bud and Sue Selig Hub for Surgical Data Science, Medical College of Wisconsin(威斯康星医学院 Bud 和 Sue Selig 外科数据科学中心);Department of Surgery, Medical College of Wisconsin(威斯康星医学院外科系)

Nathan Wolfrath, Joel Wolfrath, Hengrui Hu, Anjishnu Banerjee, Anai N. Kothari

AI总结:

针对临床机器学习部署面临的透明度不足、数据孤立等障碍,本研究通过案例实证证明医疗ML评估中纳入强基线的重要性,指出弱基线或无基线会掩盖方法价值,并提出相关最佳实践以助力临床ML落地。

摘要:

近年来,由于预测建模在各类应用领域取得成功,机器学习(ML)研究规模大幅增长。然而,在高风险临床场景中部署ML模型时,存在一些公认的障碍,包括模型透明度不足(或无法审计推理过程)、训练数据需求大且数据源孤立、以及衡量模型效用的指标复杂。在本研究中,我们通过实证表明,在医疗保健ML评估中纳入更强的基线模型会产生重要的下游效应,有助于从业者应对这些挑战。通过一系列案例研究,我们发现,省略基线或与弱基线模型(例如未经过优化的线性模型)进行比较的常见做法,会掩盖研究文献中提出的ML方法的价值。基于这些见解,我们提出了若干最佳实践,帮助从业者更有效地在临床场景中研究和部署ML模型。

英文摘要:

Machine Learning (ML) research has increased substantially in recent years, due to the success of predictive modeling across diverse application domains. However, well-known barriers exist when attempting to deploy ML models in high-stakes, clinical settings, including lack of model transparency (or the inability to audit the inference process), large training data requirements with siloed data sources, and complicated metrics for measuring model utility. In this work, we show empirically that including stronger baseline models in healthcare ML evaluations has important downstream effects that aid practitioners in addressing these challenges. Through a series of case studies, we find that the common practice of omitting baselines or comparing against a weak baseline model (e.g. a linear model with no optimization) obscures the value of ML methods proposed in the research literature. Using these insights, we propose some best practices that will enable practitioners to more effectively study and deploy ML models in clinical settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑