arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.03217cs.CLcs.AIcs.CYcs.IR

混合事实核查:集成知识图谱、大语言模型和基于搜索的检索代理提高可解释的声明验证

Hybrid Fact-Checking that Integrates Knowledge Graphs, Large Language Models, and Search-Based Retrieval Agents Improves Interpretable Claim Verification

Technical University Munich(慕尼黑工业大学)

Shaghayegh Kolli, Richard Rosenbaum, Timo Cavelius, Lasse Strothe, Andrii Lata, Jana Diesner

AI总结:

提出一种混合事实核查方法,集成知识图谱、大语言模型和实时搜索代理,通过三步流水线(KG检索、LM分类、Web搜索)在FEVER基准上达到0.93 F1分数,无需微调,并有效处理信息不足情况。

摘要:

大语言模型(LLMs)擅长生成流畅的语句,但可能缺乏对已验证信息的可靠基础。同时,基于知识图谱的事实核查器提供精确且可解释的证据,但存在覆盖范围有限或延迟的问题。通过将LLMs与知识图谱和实时搜索代理集成,我们引入了一种混合事实核查方法,利用了每个组件的各自优势。我们的系统包括三个自主步骤:1)知识图谱(KG)检索,用于在DBpedia中进行快速一跳查找;2)基于LM的分类,由任务特定的标签提示引导,产生具有内部基于规则逻辑的输出;3)仅当KG覆盖不足时调用的Web搜索代理。我们的流水线在FEVER基准测试的Supported/Refuted分割上达到了0.93的F1分数,无需任务特定的微调。为了处理“信息不足”的情况,我们进行了一项有针对性的重新标注研究,表明我们的方法经常为最初标记为“信息不足”(NEI)的声明发现有效证据,这一点得到了专家标注者和LLM评审员的确认。通过本文,我们提出了一个模块化、开源的事实核查流水线,具有回退策略和跨数据集的泛化能力。

英文摘要:

Large language models (LLMs) excel in generating fluent utterances but can lack reliable grounding in verified information. At the same time, knowledge-graph-based fact-checkers deliver precise and interpretable evidence, yet suffer from limited coverage or latency. By integrating LLMs with knowledge graphs and real-time search agents, we introduce a hybrid fact-checking approach that leverages the individual strengths of each component. Our system comprises three autonomous steps: 1) a Knowledge Graph (KG) Retrieval for rapid one-hop lookups in DBpedia, 2) an LM-based classification guided by a task-specific labeling prompt, producing outputs with internal rule-based logic, and 3) a Web Search Agent invoked only when KG coverage is insufficient. Our pipeline achieves an F1 score of 0.93 on the FEVER benchmark on the Supported/Refuted split without task-specific fine-tuning. To address Not enough information cases, we conduct a targeted reannotation study showing that our approach frequently uncovers valid evidence for claims originally labeled as Not Enough Information (NEI), as confirmed by both expert annotators and LLM reviewers. With this paper, we present a modular, opensource fact-checking pipeline with fallback strategies and generalization across datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑