arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.00133cs.CLcs.AI
收藏

生物医学领域大语言模型综述

A Survey for Large Language Models in Biomedicine

School of Medical Engineering, Xinxiang Medical University(新乡医学院医学工程学院);Shanghai AI Laboratory(上海人工智能实验室);Amazon(亚马逊公司);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School, Harvard University(哈佛大学医学院);Toursun Synbio(拓臻生物);Monash University(莫纳什大学);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);University of Cambridge(剑桥大学)
Chong Wang, Mengyao Li, Junjun He, Zhongruo Wang, Erfan Darzi, Zan Chen, Jin Ye, Tianbin Li, Yanzhou Su, Jing Ke, Kaili Qu, Shuxin Li, Yi Yu, Pietro Liò, Tianyu… 展开作者

Chong Wang, Mengyao Li, Junjun He, Zhongruo Wang, Erfan Darzi, Zan Chen, Jin Ye, Tianbin Li, Yanzhou Su, Jing Ke, Kaili Qu, Shuxin Li, Yi Yu, Pietro Liò, Tianyun Wang, Yu Guang Wang, Yiqing Shen

AI总结:

本文基于484篇文献系统综述了生物医学中大语言模型的零样本能力、微调适配策略及隐私、可解释性与伦理挑战,并提出联邦学习和可解释AI等未来方向。

摘要:

近年来,大语言模型(LLMs)的突破性进展带来了前所未有的自然语言理解与生成能力。然而,现有关于生物医学领域LLMs的综述往往只关注特定应用或模型架构,缺乏一种能够整合各生物医学子领域最新进展的全面分析。本综述基于对来自PubMed、Web of Science和arXiv等数据库的484篇文献的分析,深入考察了LLMs在生物医学中的现状、应用、挑战与前景,其特色在于关注这些模型在真实生物医学场景中的实际意义。首先,我们借助137项关键研究,探讨了LLMs在广泛生物医学任务中的零样本学习能力,包括诊断辅助、药物发现和个性化医疗等。随后,我们讨论了LLMs的适配策略,包括针对单模态和多模态LLMs的微调方法,以提升其在零样本学习无法胜任的专业生物医学场景中的表现,例如医学问答和生物医学文献的高效处理。最后,我们讨论了LLMs在生物医学领域面临的挑战,包括数据隐私担忧、模型可解释性有限、数据集质量问题,以及由于生物医学数据的敏感性、对高可靠性模型输出的需求和在医疗中部署AI的伦理影响而产生的伦理问题。为应对这些挑战,我们还指出了生物医学LLMs的未来研究方向,包括用于保护数据隐私的联邦学习方法,以及整合可解释AI方法以增强LLMs的透明度。

英文摘要:

Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model architectures, lacking a comprehensive analysis that integrates the latest advancements across various biomedical domains. This review, based on an analysis of 484 publications sourced from databases including PubMed, Web of Science, and arXiv, provides an in-depth examination of the current landscape, applications, challenges, and prospects of LLMs in biomedicine, distinguishing itself by focusing on the practical implications of these models in real-world biomedical contexts. Firstly, we explore the capabilities of LLMs in zero-shot learning across a broad spectrum of biomedical tasks, including diagnostic assistance, drug discovery, and personalized medicine, among others, with insights drawn from 137 key studies. Then, we discuss adaptation strategies of LLMs, including fine-tuning methods for both uni-modal and multi-modal LLMs to enhance their performance in specialized biomedical contexts where zero-shot fails to achieve, such as medical question answering and efficient processing of biomedical literature. Finally, we discuss the challenges that LLMs face in the biomedicine domain including data privacy concerns, limited model interpretability, issues with dataset quality, and ethics due to the sensitive nature of biomedical data, the need for highly reliable model outputs, and the ethical implications of deploying AI in healthcare. To address these challenges, we also identify future research directions of LLM in biomedicine including federated learning methods to preserve data privacy and integrating explainable AI methodologies to enhance the transparency of LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑