School of Medical Engineering, Xinxiang Medical University(新乡医学院医学工程学院);Shanghai AI Laboratory(上海人工智能实验室);Amazon(亚马逊公司);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School, Harvard University(哈佛大学医学院);Toursun Synbio(拓臻生物);Monash University(莫纳什大学);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);University of Cambridge(剑桥大学)
Chong Wang, Mengyao Li, Junjun He, Zhongruo Wang, Erfan Darzi, Zan Chen, Jin Ye, Tianbin Li, Yanzhou Su, Jing Ke, Kaili Qu, Shuxin Li, Yi Yu, Pietro Liò, Tianyu… 展开作者
Chong Wang, Mengyao Li, Junjun He, Zhongruo Wang, Erfan Darzi, Zan Chen, Jin Ye, Tianbin Li, Yanzhou Su, Jing Ke, Kaili Qu, Shuxin Li, Yi Yu, Pietro Liò, Tianyun Wang, Yu Guang Wang, Yiqing Shen
近年来,大语言模型(LLMs)的突破性进展带来了前所未有的自然语言理解与生成能力。然而,现有关于生物医学领域LLMs的综述往往只关注特定应用或模型架构,缺乏一种能够整合各生物医学子领域最新进展的全面分析。本综述基于对来自PubMed、Web of Science和arXiv等数据库的484篇文献的分析,深入考察了LLMs在生物医学中的现状、应用、挑战与前景,其特色在于关注这些模型在真实生物医学场景中的实际意义。首先,我们借助137项关键研究,探讨了LLMs在广泛生物医学任务中的零样本学习能力,包括诊断辅助、药物发现和个性化医疗等。随后,我们讨论了LLMs的适配策略,包括针对单模态和多模态LLMs的微调方法,以提升其在零样本学习无法胜任的专业生物医学场景中的表现,例如医学问答和生物医学文献的高效处理。最后,我们讨论了LLMs在生物医学领域面临的挑战,包括数据隐私担忧、模型可解释性有限、数据集质量问题,以及由于生物医学数据的敏感性、对高可靠性模型输出的需求和在医疗中部署AI的伦理影响而产生的伦理问题。为应对这些挑战,我们还指出了生物医学LLMs的未来研究方向,包括用于保护数据隐私的联邦学习方法,以及整合可解释AI方法以增强LLMs的透明度。
英文摘要:
Recent breakthroughs in large language models (LLMs) offer unprecedented natural language understanding and generation capabilities. However, existing surveys on LLMs in biomedicine often focus on specific applications or model architectures, lacking a comprehensive analysis that integrates the latest advancements across various biomedical domains. This review, based on an analysis of 484 publications sourced from databases including PubMed, Web of Science, and arXiv, provides an in-depth examination of the current landscape, applications, challenges, and prospects of LLMs in biomedicine, distinguishing itself by focusing on the practical implications of these models in real-world biomedical contexts. Firstly, we explore the capabilities of LLMs in zero-shot learning across a broad spectrum of biomedical tasks, including diagnostic assistance, drug discovery, and personalized medicine, among others, with insights drawn from 137 key studies. Then, we discuss adaptation strategies of LLMs, including fine-tuning methods for both uni-modal and multi-modal LLMs to enhance their performance in specialized biomedical contexts where zero-shot fails to achieve, such as medical question answering and efficient processing of biomedical literature. Finally, we discuss the challenges that LLMs face in the biomedicine domain including data privacy concerns, limited model interpretability, issues with dataset quality, and ethics due to the sensitive nature of biomedical data, the need for highly reliable model outputs, and the ethical implications of deploying AI in healthcare. To address these challenges, we also identify future research directions of LLM in biomedicine including federated learning methods to preserve data privacy and integrating explainable AI methodologies to enhance the transparency of LLMs.
Arizona State University(亚利桑那州立大学);Purdue University(普渡大学);University of British Columbia(不列颠哥伦比亚大学);Stanford University(斯坦福大学);The Ohio State University(俄亥俄州立大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Virginia Polytechnic Institute(弗吉尼亚多项技术学院);University of Michigan(密歇根大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Nanjing University(南京大学)
UltraMedical: Building Specialized Generalists in Biomedicine
Tsinghua University(清华大学);University of Washington(华盛顿大学);The First Affiliated Hospital of Nanchang University(南昌大学第一附属医院);Shanghai Jiao Tong University(上海交通大学)
A unified multimodal understanding and generation model for cross-disciplinary scientific research
Fudan University(复旦大学);Shanghai Academy of Artificial Intelligence for Science(上海人工智能科学研究院);Shanghai Innovation Institute(上海创新研究院);FuXi Intelligent Computing Technology Co., Ltd.(伏羲智能计算科技有限公司)
Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models
LUMIA Lab(LUMIA实验室);School of Artificial Intelligence(人工智能学院);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);Tsinghua University(清华大学);SJTU Paris Elite Institute of Technology(上海交通大学巴黎精英技术学院)
A Comprehensive Survey of Accelerated Generation Techniques in Large Language Models
Amirkabir University of Technology(阿米尔卡比尔理工大学);Stanford University(斯坦福大学);Massachusetts Institute of Technology(麻省理工学院);Columbia University(哥伦比亚大学);Amazon GenAI(亚马逊生成式AI部门)
A Survey on Model Compression for Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院)
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey
Raytheon BBN Technologies(雷神BBN技术公司);Harvard University(哈佛大学);University of Pennsylvania(宾夕法尼亚大学);University of Oregon(俄勒冈大学);University of the Basque Country (UPV/EHU)(巴斯克大学 (UPV/EHU))
SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models
ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University(浙江大学杭州国际科创中心);The Polytechnic Institute, Zhejiang University(浙江大学理工学院);ZJU-UIUC, Zhejiang University(浙江大学伊利诺伊大学厄巴纳-香槟联合学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);AntGroup(蚂蚁集团)
A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
University of Glasgow(格拉斯哥大学);University of Sheffield(谢菲尔德大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);National University of Singapore(新加坡国家大学);University of Cambridge(剑桥大学);University College London(伦敦大学学院);University of Aberdeen(阿伯丁大学);Leiden University(莱顿大学)
Natural Language Processing for Dialects of a Language: A Survey
University of New South Wales(新南威尔士大学);National Institute of Information and Communications Technology(信息通信技术研究所);University of Surrey(萨里大学);Monash University(莫纳什大学)
MedGPT-oss: Training a General-Purpose Vision-Language Model for Biomedicine
Department of Computer Science and Engineering, Lehigh University(莱斯大学计算机科学与工程系);Department of Computer Science and Engineering, University of Notre Dame(圣母大学计算机科学与工程系);Department of Health Outcomes & Biomedical Informatics, University of Florida(佛罗里达大学健康结果与生物医学信息学系);Department of Radiation Oncology, Mayo Clinic(梅奥诊所放射肿瘤科);Research Computing, University of Florida(佛罗里达大学研究计算中心);AI Technology Center, NVIDIA(NVIDIA人工智能技术中心)