Background The increasing adoption of Artificial Intelligence (AI) in healthcare has sparked growing concerns about its environmental and ethical implications. Commercial Large Language Models (LLMs), such as ChatGPT and DeepSeek, require substantial resources, while the utilization of these systems for medical purposes raises critical issues regarding patient privacy and safety. Methods We developed a customizable Retrieval-Augmented Generation (RAG) framework for medical tasks, which monitors its energy usage and CO2 emissions. This system was then used to create RAGs based on various open-source LLMs. The tested models included both general purpose models like llama3.1:8b and medgemma-4b-it, which is medical-domain specific. The best RAGs performance and energy consumption was compared to DeepSeekV3-R1 and OpenAIs o4-mini model. A dataset of medical questions was used for the evaluation. Results Custom RAG models outperformed commercial models in accuracy and energy consumption. The RAG model built on llama3.1:8B achieved the highest accuracy (58.5%) and was significantly better than other models, including o4-mini and DeepSeekV3-R1. The llama3.1-RAG also exhibited the lowest energy consumption and CO2 footprint among all models, with a Performance per kWh of 0.52 and a total CO2 emission of 473g. Compared to o4-mini, the llama3.1-RAG achieved 2.7x times more accuracy points per kWh and 172% less electricity usage while maintaining higher accuracy. Conclusion Our study demonstrates that local LLMs can be leveraged to develop RAGs that outperform commercial, online LLMs in medical tasks, while having a smaller environmental impact. Our modular framework promotes sustainable AI development, reducing electricity usage and aligning with the UNs Sustainable Development Goals.
RGAR: Recurrence Generation-augmented Retrieval for Factual-aware Medical Question Answering
King’s College London(伦敦国王学院);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);School of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程学院)
A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering
Department of Mechatronics & Industrial Engineering, Chittagong University of Engineering & Technology(吉大港工程与技术大学机电与工业工程系);Department of Mechanical Engineering, Chittagong University of Engineering & Technology(吉大港工程与技术大学机械工程系)
Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
Technical University of Munich(慕尼黑工业大学);TUM University Hospital Rechts der Isar(慕尼黑工业大学 Rechts der Isar 大学医院);German Heart Center Munich(慕尼黑德国心脏中心);Helmholtz Zentrum München(慕尼黑亥姆霍兹中心);German Consortium for Translational Cancer Research(德国转化癌症研究联盟)
Closing the gap between open-source and commercial large language models for medical evidence summarization
Columbia University(哥伦比亚大学);National Library of Medicine(美国国家医学图书馆);National Institutes of Health(美国国立卫生研究院);Weill Cornell Medicine(威尔康奈尔医学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院)
Optimizing Retrieval-Augmented Generation of Medical Content for Spaced Repetition Learning
Poznań University of Medical Sciences(波兹南医科大学);Adam Mickiewicz University(亚当·密茨凯维奇大学);Wydawnictwo Naukowe PWN(PWN科学出版社);SuperMemo World(SuperMemo世界公司);Association for Research and Applications of Artificial Intelligence(人工智能研究与应用协会)
A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs
Department of Computer Science University of California Los Angeles(计算机科学系,加州大学洛杉矶分校);Bioinformatics IDP University of California Los Angeles(生物信息学IDP,加州大学洛杉矶分校);Department of Computational Medicine University of California Los Angeles(计算医学系,加州大学洛杉矶分校)
Automated Construction of Medical Indicator Knowledge Graphs Using Retrieval Augmented Large Language Models
The second hospital of Jilin University Northeast Asia Active Aging Laboratory Jilin, China Email;QMUL DERI \ Institute Of Health Informatics, Lonodn, UK Email;QMUL School of Electronic Engineering \ Computer Science London, UK Email;The second hospital of Jilin University College of Artificial Intelligence, \ University, Jilin, China Email
Conversation AI Dialog for Medicare powered by Finetuning and Retrieval Augmented Generation
University of Florida(佛罗里达大学);National Institute of Technology Calicut(卡利卡特国家理工学院);SRM, Chennai(SRM大学(金奈));University of Cincinnati(辛辛那提大学);Dartmouth College(达特茅斯学院);Arizona State University(亚利桑那州立大学)
FHIR-RAG-MEDS: Integrating HL7 FHIR with Retrieval-Augmented Large Language Models for Enhanced Medical Decision Support
SRDC Software Research & Development and Consultancy Corporation(SRDC软件研究与开发及咨询公司);Geriatrics Department, Complejo Hospitalario Universitario de Albacete(阿尔巴塞特大学医院老年科);CIBER de Fragilidad y Envejecimiento Saludable (CIBERFES), Instituto de Salud Carlos III(健康与衰老促进CIBERFES,卡洛斯三世卫生研究所);Facultad de Medicina de Albacete, Universidad de Castilla-La Mancha(阿尔巴塞特大学医学学院,卡斯蒂利亚-拉曼查大学)
Improving Retrieval-Augmented Generation in Medicine with Iterative Follow-up Questions
University of Virginia(弗吉尼亚大学);National Library of Medicine(美国国家医学图书馆);National Institutes of Health(美国国立卫生研究院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Two-Layer Retrieval-Augmented Generation Framework for Low-Resource Medical Question Answering Using Reddit Data: Proof-of-Concept Study
Emory University(埃默里大学);Georgia Institute of Technology(佐治亚理工学院);Weill Cornell Medicine(威尔康奈尔医学院);Morehouse School of Medicine(莫尔豪斯医学院);University of Pennsylvania(宾夕法尼亚大学);Brown University(布朗大学);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院);Rutgers New Jersey Medical School(罗格斯新泽西医学院)
MasonNLP+ at SemEval-2023 Task 8: Extracting Medical Questions, Experiences and Claims from Social Media using Knowledge-Augmented Pre-trained Language Models
Learning to reason about rare diseases through retrieval-augmented agents
Technical University of Munich(慕尼黑技术大学);GE HealthCare(GE医疗);Munich Center for Machine Learning(慕尼黑机器学习中心);Klinikum Rechts der Isar(莱布尼茨医院);Helmholtz Munich(亥姆霍兹慕尼黑研究中心);King's College London(伦敦国王学院)
Intelligent Documentation in Medical Education: Can AI Replace Manual Case Logging?
Department of Computer Science, University of California, Davis, CA, USA(计算机科学系,加州大学戴维斯分校);Department of Radiology, University of California, Davis, CA, USA(放射学系,加州大学戴维斯分校)
oRetrieval Augmented Generation for 10 Large Language Models and its Generalizability in Assessing Medical Fitness
Singapore General Hospital(新加坡中央医院);Duke-NUS Medical School(杜克-新加坡国立大学医学院);Singapore National Eye Centre(新加坡国家眼科中心);Singapore Eye Research Institute(新加坡眼科研究所);Singapore Health Services(新加坡保健服务集团);KK Women’s and Children’s Hospital(竹脚妇幼医院);Chang Gung Memorial Hospital(长庚纪念医院);Chang Gung University(长庚大学);Kaohsiung Chang Gung Memorial Hospital(高雄长庚纪念医院);National Sun Yat-sen University(国立中山大学);Brigham and Women’s Hospital(布莱根和妇女医院);Harvard Medical School(哈佛医学院)
Knowledge Poisoning Attacks on Medical Multi-Modal Retrieval-Augmented Generation
Tsinghua University(清华大学);Beijing University of Posts and Telecommunications(北京邮电大学);Northwestern Polytechnical University(西北工业大学);ETH Zurich(苏黎世联邦理工学院)
Retrieval-Augmented Generation in Medicine: A Scoping Review of Technical Implementations, Clinical Applications, and Ethical Considerations
Duke–NUS Medical School(杜克-新加坡国立大学医学院);University of Cambridge(剑桥大学);The University of Tokyo(东京大学);Singapore General Hospital(新加坡中央医院);University of Geneva(日内瓦大学);Duke School of Medicine(杜克大学医学院);Duke Clinical Research Institute(杜克临床研究所);Singapore Eye Research Institute(新加坡眼科研究所);Singapore National Eye Center(新加坡国家眼科中心);Stanford University(斯坦福大学);Singapore Health Services(新加坡保健服务集团);National University of Singapore(新加坡国立大学)
Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
Department of Electrical Engineering;Computer Science University of Toledo Toledo, USA;Institute of Mathematical Sciences Claremont Graduate University Claremont, USA;Department of Bioengineering University of Toledo Toledo, USA;Department of Computer Science Bowling Green State University Bowling Green, USA
MedTutor: A Retrieval-Augmented LLM System for Case-Based Medical Education
Department of Computer Science, Yale University(耶鲁大学计算机科学系);Department of Radiology and Biomedical Imaging, Yale School of Medicine(耶鲁医学院放射学与生物医学成像系);Interdisciplinary Program for Bioengineering, Seoul National University(首尔国立大学生物工程跨学科项目)
Integrating UMLS Knowledge into Large Language Models for Medical Question Answering
National University of Singapore(新加坡国立大学);Duke-NUS Medical School(杜克-新加坡国立大学医学院);University of Tokyo(东京大学);National Institute of Advanced Industrial Science and Technology(日本产业技术综合研究所);Singapore General Hospital(新加坡中央医院);Zhejiang Lab(之江实验室);National Institutes of Health(美国国立卫生研究院);Yale University(耶鲁大学)
DeepTumorVQA: A Hierarchical 3D CT Benchmark for Stage-Wise Evaluation of Medical VLMs and Tool-Augmented Agents
Johns Hopkins University(约翰霍普金斯大学);University of Bologna(博洛尼亚大学);Istanbul Medipol University(伊斯坦布尔梅迪波尔大学);Center for Biomolecular Nanotechnologies, Istituto Italiano di Tecnologia(生物分子纳米技术中心,意大利技术研究院);The First Affiliated Hospital, Sun Yat-Sen University(中山大学第一附属医院);Tongji University(同济大学)
Iterative Multimodal Retrieval-Augmented Generation for Medical Question Answering
New York University, New York, USA(纽约大学);Tsinghua University, Beijing, China(清华大学);Independent Researcher(独立研究者);Chinese Academy of Sciences, Beijing, China(中国科学院)
ClinBench-HPB: A Clinical Benchmark for Evaluating LLMs in Hepato-Pancreato-Biliary Diseases
The Hong Kong Polytechnic University(香港理工大学);Shenzhen Institutes of Advanced Technology, CAS(深圳先进技术研究院);Zhujiang Hospital, Southern Medical University(南方医科大学珠江医院);The Key Laboratory of Biomedical Imaging Science and System, CAS(生物医学成像科学与系统重点实验室)
TAGS: A Test-Time Generalist-Specialist Framework with Retrieval-Augmented Reasoning and Verification
Mohamed bin Zayed University of Artificial Intelligence(莫莫德·本·扎耶德人工智能大学);Monash University(墨尔本大学);Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);University of Southampton(南安普顿大学)
Health-LLM: Personalized Retrieval-Augmented Disease Prediction System
Rutgers University(罗格斯大学);University of Liverpool(利物浦大学);Northwestern University(西北大学);University of Michigan(密歇根大学);University of Exeter(埃克塞特大学);New Jersey Institute of Technology(新泽西理工学院);New York University(纽约大学)