arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2509.04053cs.LG
收藏

关于预测模型与临床经验学习的对齐:一项前列腺癌案例研究

On Aligning Prediction Models with Clinical Experiential Learning: A Prostate Cancer Case Study

Jacqueline J. Vallon, William Overman, Wanqiao Xu, Neil Panjwani, Xi Ling, Sushmita Vij, Hilary P. Bagshaw, John T. Leppert, Sumit Shah, Geoffrey Sonn, Sandy Sr… 展开作者

Jacqueline J. Vallon, William Overman, Wanqiao Xu, Neil Panjwani, Xi Ling, Sushmita Vij, Hilary P. Bagshaw, John T. Leppert, Sumit Shah, Geoffrey Sonn, Sandy Srinivas, Erqi Pollom, Mark K. Buyyounouski, Mohsen Bayati

AI总结:

针对机器学习模型与临床经验学习的不一致问题,提出可复现框架,通过纳入临床知识约束实现前列腺癌预测模型对齐且不损性能,并验证了反馈驱动对齐方法的可行性。

摘要:

在过去十年中,机器学习(ML)模型在医疗保健应用中的使用迅速增长。尽管性能出色,现代ML模型并不总能捕捉到终端用户所需的模式。例如,在所有其他特征固定的情况下,模型可能预测出癌症分期与生存率之间非单调递减的关系。在本文中,我们提出了一个可复现的框架,用于研究模型行为与临床经验学习之间的这种不一致,重点关注现代ML流程的欠规格化效应。在一项前列腺癌结局预测案例研究中,我们首先通过将一项调查收集的临床知识以约束形式纳入ML模型,来识别并解决这些不一致之处,随后分析了不同欠规格化程度下该做法对模型性能和行为的影响。该方法表明,在不损害性能的前提下,使ML模型与临床经验学习对齐是可行的。受生成式AI近期文献的启发,我们通过一项与临床医生合作的随机实验,进一步检验了反馈驱动的对齐方法在非生成式AI临床风险预测模型中的可行性。我们的研究结果表明,通过我们提出的方法获取临床医生的模型偏好,约束模型和无约束模型对患者的预测方式差异越大,两者在临床解释上的差异就越明显。

英文摘要:

Over the past decade, the use of machine learning (ML) models in healthcare applications has rapidly increased. Despite high performance, modern ML models do not always capture patterns the end user requires. For example, a model may predict a non-monotonically decreasing relationship between cancer stage and survival, keeping all other features fixed. In this paper, we present a reproducible framework for investigating this misalignment between model behavior and clinical experiential learning, focusing on the effects of underspecification of modern ML pipelines. In a prostate cancer outcome prediction case study, we first identify and address these inconsistencies by incorporating clinical knowledge, collected by a survey, via constraints into the ML model, and subsequently analyze the impact on model performance and behavior across degrees of underspecification. The approach shows that aligning the ML model with clinical experiential learning is possible without compromising performance. Motivated by recent literature in generative AI, we further examine the feasibility of a feedback-driven alignment approach in non-generative AI clinical risk prediction models through a randomized experiment with clinicians. Our findings illustrate that, by eliciting clinicians' model preferences using our proposed methodology, the larger the difference in how the constrained and unconstrained models make predictions for a patient, the more apparent the difference is in clinical interpretation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑