ChatGPT explores a strategic blueprint of question answering (QA) in delivering medical diagnosis, treatment recommendations, and other healthcare support. This is achieved through the increasing incorporation of medical domain data via natural language processing (NLP) and multimodal paradigms. By transitioning the distribution of text, images, videos, and other modalities from the general domain to the medical domain, these techniques have expedited the progress of medical domain question answering (MDQA). They bridge the gap between human natural language and sophisticated medical domain knowledge or expert manual annotations, handling large-scale, diverse, unbalanced, or even unlabeled data analysis scenarios in medical contexts. Central to our focus is the utilizing of language models and multimodal paradigms for medical question answering, aiming to guide the research community in selecting appropriate mechanisms for their specific medical research requirements. Specialized tasks such as unimodal-related question answering, reading comprehension, reasoning, diagnosis, relation extraction, probability modeling, and others, as well as multimodal-related tasks like vision question answering, image caption, cross-modal retrieval, report summarization, and generation, are discussed in detail. Each section delves into the intricate specifics of the respective method under consideration. This paper highlights the structures and advancements of medical domain explorations against general domain methods, emphasizing their applications across different tasks and datasets. It also outlines current challenges and opportunities for future medical domain research, paving the way for continued innovation and application in this rapidly evolving field.
Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification
Mass General Brigham, Harvard Medical School(麻省总医院布莱根,哈佛医学院);Brigham and Women’s Hospital/Dana-Farber Cancer Institute(布莱根妇女医院/丹娜-法伯癌症研究所);Technische Universität Darmstadt(达姆施塔特工业大学);Maastricht University(马斯特里赫特大学)
Bioinformatics and Biomedical Informatics with ChatGPT: Year One Review
West Virginia University(西弗吉尼亚大学);University of Nebraska-Lincoln(内布拉斯加大学林肯分校);Arizona State University(亚利桑那州立大学);Biodesign Institute, Arizona State University(亚利桑那州立大学生物设计研究所)
From Knowledge Generation to Knowledge Verification: Examining the BioMedical Generative Capabilities of ChatGPT
MGEN -- College of Engineering, Northeastern University Miami(东北大学迈阿密分校MGEN工程学院);University of Vermont(佛蒙特大学);AGH, University of Krakow(克拉科夫AGH大学);Howard University(霍华德大学)
Vibe Medicine: Redefining Biomedical Research Through Human-AI Co-Work
School of Computing, University of Georgia(佐治亚大学计算学院);Department of Biomedical Engineering, New Jersey Institute of Technology(新泽西理工学院生物医学工程系);Department of Computer Science and Engineering, University of Texas at Arlington(德克萨斯大学阿灵顿分校计算机科学与工程系)
Emerging Challenges in Personalized Medicine: Assessing Demographic Effects on Biomedical Question Answering Systems
University of Colorado Boulder(科罗拉多大学博尔德分校);University of Colorado Denver(科罗拉多大学丹佛分校);Memorial Healthcare System(纪念医疗系统);Johannes Gutenberg University Mainz(美因茨约翰内斯·古腾堡大学)
LingShu: A Large-Scale Symptom-Centric Contextualized Knowledge Graph Bridging Traditional Chinese Medicine and Modern Biomedicine
Beijing Jiaotong University(北京交通大学);Hubei Provincial Hospital of Traditional Chinese Medicine(湖北省中医院);Hubei University of Chinese Medicine(湖北中医药大学);Hubei Province Academy of Traditional Chinese Medicine(湖北省中医药研究院);China Academy of Chinese Medical Sciences(中国中医科学院);Xiyuan Hospital(西苑医院);National Clinical Research Center for Chinese Medicine Cardiology(国家中医心血管病临床医学研究中心);Hubei Provincial Clinical Research Center for Acupuncture and Moxibustion in Obesity Treatment(湖北省肥胖病针灸临床研究中心);Hubei Shizhen Laboratory(湖北时珍实验室);Tianjin Ta(天津(此处原文未完整,按原文提取))
Differentiate ChatGPT-generated and Human-written Medical Texts
South China University of Technology(华南理工大学);University of Georgia(佐治亚大学);University of Texas at Arlington(德克萨斯大学阿灵顿分校);Massachusetts General Hospital and Harvard Medical School(马萨诸塞总医院和哈佛医学院)
Utilizing Large Language Models for Named Entity Recognition in Traditional Chinese Medicine against COVID-19 Literature: Comparative Study
China Academy of Chinese Medical Sciences(中国中医科学院);GESIS—Leibniz Institute for the Social Sciences(GESIS——莱布尼茨社会科学研究所);University of Bonn(波恩大学);Capital Medical University(首都医科大学)
Exploiting ChatGPT for Diagnosing Autism-Associated Language Disorders and Identifying Distinct Features
University at Albany(奥尔巴尼大学);West Virginia University(西弗吉尼亚大学);Washington University in St. Louis(圣路易斯华盛顿大学);Camas High School(卡马斯高中);California Institute of Technology(加州理工学院)
Large Language Models Streamline Automated Machine Learning for Clinical Studies
University Hospital Aachen(亚琛大学医院);RWTH Aachen University(亚琛工业大学);Technical University Dresden(德累斯顿工业大学);National Center for Tumor Diseases (NCT)(国家肿瘤疾病中心 (NCT));University Hospital Heidelberg(海德堡大学医院)
Doctor Sun: A Bilingual Multimodal Large Language Model for Biomedical AI
Key Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education East China University of Science and Technology(能源化工过程智能制造重点实验室,东华大学);Research Institute of Intelligent Control and Systems Harbin Institute of Technology(智能控制与系统研究室,哈尔滨工业大学);Department of Emergency Medicine, Sir Run Run Shaw Hospital Zhejiang University School of Medicine(浙江大学医学院急诊医学科);Provincial Key Laboratory of Precise Diagnosis Treatment of Abdominal Infection, Sir Run Run Shaw Hospital Zhejiang University School of Medicine(腹部感染精准诊断治疗省级重点实验室,浙江大学医学院);School of Medicine Shaoxing University(绍兴大学医学院)
Doctor Sun是一种双语多模态大语言模型,通过整合预训练视觉编码器和医学LLM,提升生物医学多模态任务的性能,并提供SunMed-VL数据集支持研究进展。
Pattern Recognition or Medical Knowledge? The Problem with Multiple-Choice Questions in Medicine
Université catholique de Louvain(鲁汶天主教大学);Louvain Research Institute in Management and Organizations(鲁汶管理与组织研究所);Cliniques universitaires Saint-Luc(圣吕克大学诊所)
Delving into LLM-assisted writing in biomedical publications through excess vocabulary
Hertie Institute for AI in Brain Health, University of Tübingen, Germany(人工智能与脑健康赫尔蒂研究所、图宾根大学,德国);Northwestern University, Evanston, Illinois, USA(西北大学,埃文斯顿,伊利诺伊州,美国)
A Survey of Large Language Models in Medicine: Progress, Application, and Challenge
University of Oxford(牛津大学);Imperial College London(帝国理工学院);University of Waterloo(滑铁卢大学);University of Rochester(罗切斯特大学);University College London(伦敦大学学院);Western University(韦仕敦大学);University of Georgia(佐治亚大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Alibaba(阿里巴巴);Harvard T.H. Chan School of Public Health(哈佛大学陈曾熙公共卫生学院);Massachusetts Institute of Technology(麻省理工学院);Yale University(耶鲁大学);Tencent(腾讯);Amazon(亚马逊);Oxford-Suzhou Centre for Advanced Research(牛津大学高等研究院(苏州))
A Zero-shot and Few-shot Study of Instruction-Finetuned Large Language Models Applied to Clinical and Biomedical Tasks
LIA, Avignon Université(阿维尼翁大学 LIA 实验室);Zenidoc(Zenidoc 公司);Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);LS2N, UMR 6004(南特数字科学实验室)
Ensuring Safety and Trust: Analyzing the Risks of Large Language Models in Medicine
University of Maryland at College Park(马里兰大学帕克分校);University of Virginia(弗吉尼亚大学);Howard University(霍华德大学);Albert Einstein College of Medicine(阿尔伯特·爱因斯坦医学院);Universidad de Chile(智利大学);University of Florida(佛罗里达大学)
School of Medical Engineering, Xinxiang Medical University(新乡医学院医学工程学院);Shanghai AI Laboratory(上海人工智能实验室);Amazon(亚马逊公司);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School, Harvard University(哈佛大学医学院);Toursun Synbio(拓臻生物);Monash University(莫纳什大学);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);University of Cambridge(剑桥大学)
BioPars: A Pretrained Biomedical Large Language Model for Persian Biomedical Text Mining
Department of Computer Science, Faculty of Education, University of Kufa(计算机科学系,教育学院,科菲大学);Department of Computer Science, Florida State University(计算机科学系,佛罗里达州立大学);Department of Computer Engineering, Velayat University(计算机工程系,瓦莱yat大学);Department of Mechanical Engineering, Amirkabir University of Technology(机械工程系,阿米卡比尔技术大学);Department of Computer Engineering, Ferdowsi University of Mashhad(计算机工程系,法尔德大学)
ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports
University Hospital, LMU Munich(慕尼黑大学附属医院);LMU Munich(慕尼黑大学);Comprehensive Pneumology Center (CPC-M)(综合肺病中心(CPC-M));German Center for Lung Research (DZL)(德国肺研究中心(DZL));Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML))
Biomedical Large Languages Models Seem not to be Superior to Generalist Models on Unseen Medical Data
Charité - Universitätsmedizin Berlin(柏林夏里特医学院);Freie Universität Berlin(柏林自由大学);Humboldt Universität zu Berlin(柏林洪堡大学);Athinoula A. Martinos Center for Biomedical Imaging(雅典娜·马蒂诺斯生物医学成像中心);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Institute for AI in Medicine (IKIM)(医学人工智能研究所);University Hospital Essen (AöR)(埃森大学医院);Technical University of Munich(慕尼黑工业大学);University Hospital Aachen(亚琛大学医院);Cancer Research Center Cologne Essen (CCCE)(科隆埃森癌症研究中心);West German Cancer Center Essen(西德埃森癌症中心);German Cancer Consortium (DKTK, Partner site Essen)(德国癌症联盟(埃森合作站点));TU Dortmund(多特蒙德工业大学);Bakar Computational Health Sciences Institute(巴卡尔计算健康科学研究所);University of California, San Francisco(加州大学旧金山分校)
Large Language Models in Biomedical and Health Informatics: A Review with Bibliometric Analysis
University of Michigan(密歇根大学);Stanford University(斯坦福大学);University of Maryland(马里兰大学);Rutgers University(罗格斯大学);University of California, Los Angeles(加州大学洛杉矶分校);Shandong University(山东大学)
Can Large Language Models Logically Predict Myocardial Infarction? Evaluation based on UK Biobank Cohort
Beijing University of Chinese Medicine(北京中医药大学);Tianjin University(天津大学);National Yang-Ming University(国立阳明大学);Taipei Veterans General Hospital(台北荣民总医院);Beijing Normal University(北京师范大学)
本研究基于 UK Biobank 队列评估 ChatGPT 和 GPT-4 逻辑预测心肌梗死风险的能力,发现当前 LLMs 性能不及传统模型,尚未准备好应用于临床医学。
Performance Evaluation of Lightweight Open-source Large Language Models in Pediatric Consultations: A Comparative Analysis
Children’s Hospital of Chongqing Medical University(重庆医科大学附属儿童医院);Stanford University School of Medicine(斯坦福大学医学院);Chongqing University of Technology(重庆理工大学);Columbia University(哥伦比亚大学)
BenCao: An Instruction-Tuned Large Language Model for Traditional Chinese Medicine
Community Health Service Center Shanghai Pudong New Area(上海浦东新区社区卫生服务中心);School of Acupuncture-Moxibustion and Tuina, Shanghai University of Traditional Chinese Medicine(上海中医药大学针灸推拿学院)
本文提出基于 ChatGPT 的中医药多模态助手 BenCao,通过自然语言指令微调、知识库、思维链模拟、专家反馈及外部 API 整合,提升诊断、药材识别与体质分类性能并实现部署。
Medical Foundation Models are Susceptible to Targeted Misinformation Attacks
University Hospital Aachen(亚琛大学医院);University Medical Center of the Johannes Gutenberg-University(约翰内斯·古腾堡大学医学中心);University Medicine Essen(埃森大学医学部);Ocumeda GmbH(Ocumeda有限公司);Charité - Universitätsmedizin Berlin(柏林夏里特医学院);Freie Universität Berlin(柏林自由大学);Humboldt Universität zu Berlin(柏林洪堡大学);Berlin Institute of Health at Charité - Universitätsmedizin Berlin(柏林夏里特医学院柏林健康研究所);Technical University Dresden(德累斯顿工业大学);University Hospital Dresden(德累斯顿大学医院);University Hospital Heidelberg(海德堡大学医院)