Large Language Models (LLMs) have exhibited remarkable proficiency in natural language understanding, prompting extensive exploration of their potential applications across diverse domains. In the medical domain, open-source LLMs have demonstrated moderate efficacy following domain-specific fine-tuning; however, they remain substantially inferior to proprietary models such as GPT-4 and GPT-3.5. These open-source models encounter limitations in the comprehensiveness of domain-specific knowledge and exhibit a propensity for 'hallucinations' during text generation. To mitigate these issues, researchers have implemented the Retrieval-Augmented Generation (RAG) approach, which augments LLMs with background information from external knowledge bases while preserving the model's internal parameters. However, document noise can adversely affect performance, and the application of RAG in the medical field remains in its nascent stages. This study presents the Bailicai framework: a novel integration of retrieval-augmented generation with large language models optimized for the medical domain. The Bailicai framework augments the performance of LLMs in medicine through the implementation of four sub-modules. Experimental results demonstrate that the Bailicai approach surpasses existing medical domain LLMs across multiple medical benchmarks and exceeds the performance of GPT-3.5. Furthermore, the Bailicai method effectively attenuates the prevalent issue of hallucinations in medical applications of LLMs and ameliorates the noise-related challenges associated with traditional RAG techniques when processing irrelevant or pseudo-relevant documents.
RAR$^2$: Retrieval-Augmented Medical Reasoning via Thought-Driven Retrieval
Department of Computing, The Hong Kong Polytechnic University(计算机系,香港理工大学);Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology(可信自主系统研究院和计算机科学与工程系,南方科技大学)
Bias Evaluation and Mitigation in Retrieval-Augmented Medical Question-Answering Systems
University of Pittsburgh(匹兹堡大学);School of Computing and Information, University of Pittsburgh(匹兹堡大学计算与信息学院);Clinical and Translational Science Institute, University of Pittsburgh(匹兹堡大学临床与转化科学研究所);University of Pittsburgh Medical Center(匹兹堡大学医学中心)
A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering
Department of Mechatronics & Industrial Engineering, Chittagong University of Engineering & Technology(吉大港工程与技术大学机电与工业工程系);Department of Mechanical Engineering, Chittagong University of Engineering & Technology(吉大港工程与技术大学机械工程系)
RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering
King’s College London(伦敦国王学院);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程学院)
Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
Technical University of Munich(慕尼黑工业大学);TUM University Hospital Rechts der Isar(慕尼黑工业大学 Rechts der Isar 大学医院);German Heart Center Munich(慕尼黑德国心脏中心);Helmholtz Zentrum München(慕尼黑亥姆霍兹中心);German Consortium for Translational Cancer Research(德国转化癌症研究联盟)
Optimizing Retrieval-Augmented Generation of Medical Content for Spaced Repetition Learning
Poznań University of Medical Sciences(波兹南医科大学);Adam Mickiewicz University(亚当·密茨凯维奇大学);Wydawnictwo Naukowe PWN(PWN科学出版社);SuperMemo World(SuperMemo世界公司);Association for Research and Applications of Artificial Intelligence(人工智能研究与应用协会)
Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale
Department of Information Science and Applied Artificial Intelligence(信息科学与应用人工智能系)
Conversation AI Dialog for Medicare powered by Finetuning and Retrieval Augmented Generation
University of Florida(佛罗里达大学);National Institute of Technology Calicut(卡利卡特国家理工学院);SRM, Chennai(SRM大学(金奈));University of Cincinnati(辛辛那提大学);Dartmouth College(达特茅斯学院);Arizona State University(亚利桑那州立大学)
Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questions
University of Virginia(弗吉尼亚大学);National Library of Medicine(美国国家医学图书馆);National Institutes of Health(美国国立卫生研究院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Two-Layer Retrieval-Augmented Generation Framework for Low-Resource Medical Question Answering Using Reddit Data: Proof-of-Concept Study
Emory University(埃默里大学);Georgia Institute of Technology(佐治亚理工学院);Weill Cornell Medicine(威尔康奈尔医学院);Morehouse School of Medicine(莫尔豪斯医学院);University of Pennsylvania(宾夕法尼亚大学);Brown University(布朗大学);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院);Rutgers New Jersey Medical School(罗格斯新泽西医学院)
Retrieval-Augmented Generation in Medicine: A Scoping Review of Technical Implementations, Clinical Applications, and Ethical Considerations
Duke–NUS Medical School(杜克-新加坡国立大学医学院);University of Cambridge(剑桥大学);The University of Tokyo(东京大学);Singapore General Hospital(新加坡中央医院);University of Geneva(日内瓦大学);Duke School of Medicine(杜克大学医学院);Duke Clinical Research Institute(杜克临床研究所);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Center(新加坡国家眼科中心);Stanford University(斯坦福大学);Singapore Health Services(新加坡保健服务集团);National University of Singapore(新加坡国立大学)
Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
Department of Electrical Engineering;Computer Science University of Toledo Toledo, USA;Institute of Mathematical Sciences Claremont Graduate University Claremont, USA;Department of Bioengineering University of Toledo Toledo, USA;Department of Computer Science Bowling Green State University Bowling Green, USA
MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluation
Data Clinic, University Hospital of Nantes, France(南特大学医院数据诊所,法国);Nantes Université, École Centrale Nantes, CNRS, LS2N, France(南特大学,中央理工学院南特分校,国家科学研究中心,LS2N,法国)