This paper conducts a comprehensive investigation into applying large language models, particularly on BioBERT, in healthcare. It begins with thoroughly examining previous natural language processing (NLP) approaches in healthcare, shedding light on the limitations and challenges these methods face. Following that, this research explores the path that led to the incorporation of BioBERT into healthcare applications, highlighting its suitability for addressing the specific requirements of tasks related to biomedical text mining. The analysis outlines a systematic methodology for fine-tuning BioBERT to meet the unique needs of the healthcare domain. This approach includes various components, including the gathering of data from a wide range of healthcare sources, data annotation for tasks like identifying medical entities and categorizing them, and the application of specialized preprocessing techniques tailored to handle the complexities found in biomedical texts. Additionally, the paper covers aspects related to model evaluation, with a focus on healthcare benchmarks and functions like processing of natural language in biomedical, question-answering, clinical document classification, and medical entity recognition. It explores techniques to improve the model's interpretability and validates its performance compared to existing healthcare-focused language models. The paper thoroughly examines ethical considerations, particularly patient privacy and data security. It highlights the benefits of incorporating BioBERT into healthcare contexts, including enhanced clinical decision support and more efficient information retrieval. Nevertheless, it acknowledges the impediments and complexities of this integration, encompassing concerns regarding data privacy, transparency, resource-intensive requirements, and the necessity for model customization to align with diverse healthcare domains.
AI-assisted Knowledge Discovery in Biomedical Literature to Support Decision-making in Precision Oncology
Sidney Kimmel Comprehensive Cancer Center, Johns Hopkins School of Medicine(约翰斯·霍普金斯大学医学院西德尼·金梅尔综合癌症中心);Johns Hopkins School of Medicine(约翰斯·霍普金斯大学医学院)
University of Toronto(多伦多大学);Vector Institute for AI(人工智能向量研究所);Johns Hopkins Medical Institutions(约翰霍普金斯医学机构);University Health Network(医疗网络);Algoma University(阿尔戈马大学);University of Iowa Hospitals & Clinics(爱荷华大学医院与诊所);University of Edinburgh(爱丁堡大学)
Crowdsourcing with Enhanced Data Quality Assurance: An Efficient Approach to Mitigate Resource Scarcity Challenges in Training Large Language Models for Healthcare
The University of Arizona(亚利桑那大学);UC San Diego(加州大学圣迭戈分校)
KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinations
Kyoto University(京都大学);The Hong Kong University of Science and Technology(香港科技大学);Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);The University of Tokyo(东京大学)
Lightweight Transformers for Clinical Natural Language Processing
University of Oxford(牛津大学);NLPie Research(NLPie研究院);University of Surrey(萨里大学);Oxford-Suzhou Centre for Advanced Research(牛津苏州高等研究院);Nuffield Department of Population Health, University of Oxford(牛津大学纳菲尔德人口健康系);Pandemic Sciences Institute, University of Oxford(牛津大学流行病科学研究所);Sharif University of Technology(谢里夫理工大学);Infectious Diseases Data Observatory (IDDO), University of Oxford(牛津大学传染病数据观测站(IDDO))
Relation Extraction Using Large Language Models: A Case Study on Acupuncture Point Locations
The University of Texas Health Science Center at Houston(德克萨斯大学休斯顿健康科学中心);Yale University(耶鲁大学);Mayo Clinic(妙佑医疗国际);China Academy of Chinese Medical Sciences(中国中医科学院);The University of Texas MD Anderson Cancer Center(德克萨斯大学MD安德森癌症中心)
本文以 WHO 标准的 361 个穴位、3,174 个定位关系为语料,比较 GPT 与 LSTM、BioBERT 的关系抽取性能,发现微调 GPT-3.5 表现最佳,微平均 F1 达 0.92。
A Framework for Human Evaluation of Large Language Models in Healthcare Derived from Literature Review
University of Pittsburgh(匹兹堡大学);University of Pittsburgh Medical Center(匹兹堡大学医学中心);University of Texas Health Houston(德克萨斯大学休斯顿健康科学中心);Cleveland Clinic(克利夫兰诊所);Keck School of Medicine, University of Southern California(南加州大学凯克医学院);Weill Cornell Medicine(威尔康奈尔医学院)
DeepSeek in Healthcare: A Survey of Capabilities, Risks, and Clinical Applications of Open-Source Large Language Models
Weill Cornell Medicine, Cornell University(威尔康奈尔医学院,康奈尔大学);Johns Hopkins University(约翰斯·霍普金斯大学);Touro University College of Osteopathic Medicine(图罗大学整骨医学院)
Empathy by Design: Aligning Large Language Models for Healthcare Dialogue
Department of Public Health Sciences, The University of Texas at El Paso, USA(公共卫生科学系,德克萨斯理工大学埃尔帕索分校);Department of Nursing, The University of Texas at El Paso, USA(护理系,德克萨斯理工大学埃尔帕索分校);Department of Rehabilitation Sciences, The University of Texas at El Paso, USA(康复科学系,德克萨斯理工大学埃尔帕索分校)
From Explainable to Interpretable Deep Learning for Natural Language Processing in Healthcare: How Far from Reality?
School of Computer Science and Electronic Engineering, University of Essex(埃塞克斯大学计算机科学与电子工程学院);Harvard Medical School(哈佛医学院);Boston Children’s Hospital(波士顿儿童医院);University of Southampton(南安普顿大学);Athena Research Centre(雅典娜研究中心)
CollectiveSFT: Scaling Large Language Models for Chinese Medical Benchmark with Collective Instructions in Healthcare
School of Software Engineering(软件工程学院);University of Science and Technology of China(中国科学技术大学);Shenzhen Institute of Advanced Technology(深圳先进技术研究院);Chinese Academy of Sciences(中国科学院);Xiangshui County Party School(响水县党校);School of Biomedical Engineering(生物医学工程学院);UNSW(新南威尔士大学)
The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare