arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.02460cs.CL
收藏

迈向Omni-RAG:面向医疗应用中大语言模型的综合检索增强生成

Towards Omni-RAG: Comprehensive Retrieval-Augmented Generation for Large Language Models in Medical Applications

Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)

Zhe Chen, Yusheng Liao, Shuyang Jiang, Pingjie Wang, Yiqiu Guo, Yanfeng Wang, Yu Wang

AI总结:

针对大语言模型在医疗应用中因知识有限产生幻觉的问题,提出MedOmniKB知识库和Source Planning Optimisation方法,通过专家模型探索计划并训练小模型学习来源对齐,显著提升多源规划性能并达到SOTA。

摘要:

大语言模型在应对医疗挑战方面具有潜力,如医疗诊断推理、研究知识获取、临床决策和消费者健康咨询支持。然而,由于医学知识有限,它们常产生幻觉。因此,引入外部知识至关重要,这需要多源知识获取。我们将此挑战构建为来源规划问题,即根据不同来源的属性制定适合上下文的查询。现有方法要么忽视来源规划,要么因模型对来源的预期与实际内容不匹配而无法有效实现。为弥补此差距,我们提出MedOmniKB,一个包含多体裁和多结构医学知识来源的存储库。利用这些来源,我们提出Source Planning Optimisation方法,增强多源利用。我们的方法让专家模型探索和评估潜在计划,同时训练较小模型学习来源对齐。实验结果表明,我们的方法显著提升多源规划性能,使优化后的小模型在利用多样化医学知识来源方面达到SOTA结果。

英文摘要:

Large language models hold promise for addressing medical challenges, such as medical diagnosis reasoning, research knowledge acquisition, clinical decision-making, and consumer health inquiry support. However, they often generate hallucinations due to limited medical knowledge. Incorporating external knowledge is therefore critical, which necessitates multi-source knowledge acquisition. We address this challenge by framing it as a source planning problem, which is to formulate context-appropriate queries tailored to the attributes of diverse sources. Existing approaches either overlook source planning or fail to achieve it effectively due to misalignment between the model's expectation of the sources and their actual content. To bridge this gap, we present MedOmniKB, a repository comprising multigenre and multi-structured medical knowledge sources. Leveraging these sources, we propose the Source Planning Optimisation method, which enhances multi-source utilisation. Our approach involves enabling an expert model to explore and evaluate potential plans while training a smaller model to learn source alignment. Experimental results demonstrate that our method substantially improves multi-source planning performance, enabling the optimised small model to achieve state-of-the-art results in leveraging diverse medical knowledge sources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑