arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.05723cs.AI
收藏

通过细粒度知识验证缓解金融检索增强生成中的幻觉

Mitigating Hallucination in Financial Retrieval-Augmented Generation via Fine-Grained Knowledge Verification

Taoye Yin, Haoyuan Hu, Yaxin Fan, Xinhao Chen, Xinya Wu, Kai Deng, Kezun Zhang, Feng Wang

AI总结:

本文提出RLFKV框架,通过细粒度知识验证和信息量奖励,缓解金融RAG系统中的幻觉问题,提升响应准确性与一致性。

摘要:

在金融检索增强生成(RAG)系统中,模型经常依赖检索到的文档来生成准确的响应,因为金融领域具有时间敏感性。虽然检索文档有助于弥补知识缺口,但模型生成的响应仍然会出现与检索信息相矛盾的幻觉。为缓解这种不一致,我们提出了一种增强细粒度知识验证(RLFKV)的强化学习框架。我们的方法将金融响应分解为原子知识单元,并评估每个单元的正确性以计算细粒度的忠实奖励。这种奖励提供更精确的优化信号,从而提高与检索文档的一致性。此外,为了防止奖励黑客(例如过于简短的回复),我们引入了信息量奖励,鼓励策略模型至少保留与基础模型同样多的知识单元。在公开的金融数据描述(FDD)任务和我们新提出的FDD-ANT数据集上的实验表明,取得了持续的改进,证实了我们方法的有效性。

英文摘要:

In financial Retrieval-Augmented Generation (RAG) systems, models frequently rely on retrieved documents to generate accurate responses due to the time-sensitive nature of the financial domain. While retrieved documents help address knowledge gaps, model-generated responses still suffer from hallucinations that contradict the retrieved information. To mitigate this inconsistency, we propose a Reinforcement Learning framework enhanced with Fine-grained Knowledge Verification (RLFKV). Our method decomposes financial responses into atomic knowledge units and assesses the correctness of each unit to compute the fine-grained faithful reward. This reward offers more precise optimization signals, thereby improving alignment with the retrieved documents. Additionally, to prevent reward hacking (e.g., overly concise replies), we incorporate an informativeness reward that encourages the policy model to retain at least as many knowledge units as the base model. Experiments conducted on the public Financial Data Description (FDD) task and our newly proposed FDD-ANT dataset demonstrate consistent improvements, confirming the effectiveness of our approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑