arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2601.04531cs.IRcs.AI
收藏

Self-MedRAG:一种用于可靠医学问答的自反思混合检索增强生成框架

Self-MedRAG: a Self-Reflective Hybrid Retrieval-Augmented Generation Framework for Reliable Medical Question Answering

Bina Nusantara University(建国大学)

Jessica Ryan, Alexander I. Gumilang, Robert Wiliam, Derwin Suhartono

AI总结:

Self-MedRAG通过混合检索与自反思机制提升医学问答的准确性和可靠性。

摘要:

大型语言模型(LLMs)在医学问答(QA)中展现了显著潜力,但它们仍容易产生幻觉和缺乏依据的推理,限制了其在高风险临床场景中的可靠性。虽然检索增强生成(RAG)通过引入外部知识缓解了这些问题,但传统单次检索往往无法解决需要多步推理的复杂生物医学查询。为此,我们提出了Self-MedRAG,一种自反思混合框架,旨在模仿临床推理的迭代假设验证过程。Self-MedRAG集成了混合检索策略,通过反向排名融合(RRF)结合稀疏(BM25)和密集(Contriever)检索器以最大化证据覆盖。它使用生成器生成带有支持理由的答案,这些理由随后由轻量级的自反思模块通过自然语言推理(NLI)或基于LLM的验证进行评估。如果理由缺乏充分的证据支持,系统会自动重新表述查询并迭代以优化上下文。我们在MedQA和PubMedQA基准上评估了Self-MedRAG。结果表明,我们的混合检索方法显著优于单检索器基线。此外,自反思循环的加入带来了显著收益,使MedQA的准确率从80.00%提升至83.33%,PubMedQA的准确率从69.10%提升至79.82%。这些发现证实,将混合检索与基于证据的迭代自反思相结合,能有效减少不支持的声明,提高基于LLM系统的临床可靠性。

英文摘要:

Large Language Models (LLMs) have demonstrated significant potential in medical Question Answering (QA), yet they remain prone to hallucinations and ungrounded reasoning, limiting their reliability in high-stakes clinical scenarios. While Retrieval-Augmented Generation (RAG) mitigates these issues by incorporating external knowledge, conventional single-shot retrieval often fails to resolve complex biomedical queries requiring multi-step inference. To address this, we propose Self-MedRAG, a self-reflective hybrid framework designed to mimic the iterative hypothesis-verification process of clinical reasoning. Self-MedRAG integrates a hybrid retrieval strategy, combining sparse (BM25) and dense (Contriever) retrievers via Reciprocal Rank Fusion (RRF) to maximize evidence coverage. It employs a generator to produce answers with supporting rationales, which are then assessed by a lightweight self-reflection module using Natural Language Inference (NLI) or LLM-based verification. If the rationale lacks sufficient evidentiary support, the system autonomously reformulates the query and iterates to refine the context. We evaluated Self-MedRAG on the MedQA and PubMedQA benchmarks. The results demonstrate that our hybrid retrieval approach significantly outperforms single-retriever baselines. Furthermore, the inclusion of the self-reflective loop yielded substantial gains, increasing accuracy on MedQA from 80.00% to 83.33% and on PubMedQA from 69.10% to 79.82%. These findings confirm that integrating hybrid retrieval with iterative, evidence-based self-reflection effectively reduces unsupported claims and enhances the clinical reliability of LLM-based systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑