arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.02558cs.CLcs.CV
收藏

面向生成式建模研究的临床人工智能最低信息清单(MI-CLAIM-GEN)

The Minimum Information about CLinical Artificial Intelligence Checklist for Generative Modeling Research (MI-CLAIM-GEN)

University of California, San Francisco(加州大学旧金山分校);University of California, Berkeley(加州大学伯克利分校);University of California, Office of the President(加州大学校长办公室);Bayesian Health(贝叶斯健康公司);Johns Hopkins University(约翰斯·霍普金斯大学);Scripps Research(斯克里普斯研究所);University of Chicago(芝加哥大学);Qualified Health PBC(合格健康公益公司)
Brenda Y. Miao, Irene Y. Chen, Christopher YK Williams, Jaysón Davidson, Augusto Garcia-Agundez, Shenghuan Sun, Travis Zack, Suchi Saria, Rima Arnaout, Giorgio … 展开作者

Brenda Y. Miao, Irene Y. Chen, Christopher YK Williams, Jaysón Davidson, Augusto Garcia-Agundez, Shenghuan Sun, Travis Zack, Suchi Saria, Rima Arnaout, Giorgio Quer, Hossein J. Sadaei, Ali Torkamani, Brett Beaulieu-Jones, Bin Yu, Milena Gianfrancesco, Atul J. Butte, Beau Norgeot, Madhumita Sushil

AI总结:

针对临床生成式AI研究报告缺乏规范的问题,研究基于原有MI-CLAIM清单制定了MI-CLAIM-GEN清单,覆盖训练、评估等多方面差异及伦理要求,填补相关标准空白。

摘要:

生成式模型(包括大语言模型(LLMs)、视觉语言模型(VLMs)和扩散模型)的最新进展推动了医学领域自然语言与图像处理的发展,也标志着生物医学模型的开发与部署方式发生了重大范式转变。尽管这些模型对新任务的适配性极强,但对其应用进行规模化推广与评估仍带来了以往框架未能解决的新挑战。尤其是这类模型仅需极少甚至无需专门训练数据即可生成有用输出的能力(即“零样本”或“少样本”方法),以及其输出的开放性特征,都要求制定新的指南,以规范临床生成式模型研究的稳健报告流程。针对美国第141103号行政命令及多个新兴的全国临床人工智能评估网络所指出的临床人工智能工具开发标准与最佳实践的空白,我们在原有MI-CLAIM清单的基础上,着手将部分此类指南规范化。这份新的清单即MI-CLAIM-GEN(见表1),旨在解决新型生成式模型与非生成式(“预测型”)人工智能模型在训练、评估、可解释性和可复现性方面的差异。MI-CLAIM-GEN清单还力求明确非结构化临床数据下的队列选择报告要求,并新增了关于临床人工智能研究符合伦理标准的相关条目。

英文摘要:

Recent advances in generative models, including large language models (LLMs), vision language models (VLMs), and diffusion models, have accelerated the field of natural language and image processing in medicine and marked a significant paradigm shift in how biomedical models can be developed and deployed. While these models are highly adaptable to new tasks, scaling and evaluating their usage presents new challenges not addressed in previous frameworks. In particular, the ability of these models to produce useful outputs with little to no specialized training data ("zero-" or "few-shot" approaches), as well as the open-ended nature of their outputs, necessitate the development of new guidelines for robust reporting of clinical generative model research. In response to gaps in standards and best practices for the development of clinical AI tools identified by US Executive Order 141103 and several emerging national networks for clinical AI evaluation, we begin to formalize some of these guidelines by building on the original MI-CLAIM checklist. The new checklist, MI-CLAIM-GEN (Table 1), aims to address differences in training, evaluation, interpretability, and reproducibility of new generative models compared to non-generative ("predictive") AI models. This MI-CLAIM-GEN checklist also seeks to clarify cohort selection reporting with unstructured clinical data and adds additional items on alignment with ethical standards for clinical AI research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑