TC-RAG:Turing-Complete RAG's Case study on Medical LLM Systems
Peking University(北京大学);City University of Hong Kong (Dongguan)(香港城市大学(东莞));University of Chinese Academy of Sciences(中国科学院大学);ShanghaiTech University(上海科技大学);University of Electronic Science and Technology of China(电子科技大学)
In the pursuit of enhancing domain-specific Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) emerges as a promising solution to mitigate issues such as hallucinations, outdated knowledge, and limited expertise in highly specialized queries. However, existing approaches to RAG fall short by neglecting system state variables, which are crucial for ensuring adaptive control, retrieval halting, and system convergence. In this paper, we introduce the TC-RAG through rigorous proof, a novel framework that addresses these challenges by incorporating a Turing Complete System to manage state variables, thereby enabling more efficient and accurate knowledge retrieval. By leveraging a memory stack system with adaptive retrieval, reasoning, and planning capabilities, TC-RAG not only ensures the controlled halting of retrieval processes but also mitigates the accumulation of erroneous knowledge via Push and Pop actions. In the case study of the medical domain, our extensive experiments on real-world healthcare datasets demonstrate the superiority of TC-RAG over existing methods in accuracy by over 7.20\%. Our dataset and code have been available at https://github.com/Artessay/TC-RAG .
MC-RAG System: A Structure-Driven RAG System for Multi-Constraint Queries
College of Information and Electrical Engineering, China Agricultural University(中国农业大学信息电气工程学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);Key Laboratory of Agricultural Informatization Standardization, Ministry of Agriculture and Rural Affairs(农业农村部农业信息化标准化重点实验室)
Hyper-RAG: Combating LLM Hallucinations using Hypergraph-Driven Retrieval-Augmented Generation
School of Software, Tsinghua University(清华大学软件学院);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University(西安交通大学人工智能与机器人研究所);School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);School of Science, Shanghai University(上海大学理学院);School of Information and Electronics, Beijing Institute of Technology(北京理工大学信息与电子学院)
Optimizing Retrieval-Augmented Generation of Medical Content for Spaced Repetition Learning
Poznań University of Medical Sciences(波兹南医科大学);Adam Mickiewicz University(亚当·密茨凯维奇大学);Wydawnictwo Naukowe PWN(PWN科学出版社);SuperMemo World(SuperMemo世界公司);Association for Research and Applications of Artificial Intelligence(人工智能研究与应用协会)
JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability
Manning College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院);Department of Medicine, University of Massachusetts Medical School(马萨诸塞大学医学院医学系);Miner School of Computer and Information Sciences, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校计算机与信息科学学院);Center for Healthcare Organization and Implementation Research, VA Bedford Health Care(弗吉尼亚州贝德福德医疗保健系统医疗保健组织与实施研究中心)
Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale
Department of Information Science and Applied Artificial Intelligence(信息科学与应用人工智能系)
Grounding Large Language Models in Clinical Evidence: A Retrieval-Augmented Generation System for Querying UK NICE Clinical Guidelines
Institute of Health Informatics, University College London(健康信息学研究所,伦敦大学学院);Department of Biostatistics and Health Informatics, King’s College London(生物统计学与健康信息学系,伦敦国王学院);EPSRC DRIVE-Health CDT, London, U.K.(EPSRC DRIVE-Health CDT,伦敦,英国);Imperial College Healthcare NHS Trust(帝国学院医疗 NHS 信托);Black Country Healthcare NHS Foundation Trust(黑斯廷斯地区医疗 NHS 基础信托);Feldon Lane Surgery, The Dudley Group NHS Foundation Trust(费尔顿车道诊所,德比集团 NHS 基础信托);The Cleveland Clinic, London, U.K.(克利夫兰诊所,伦敦,英国);CogStack Limited(CogStack 有限公司)