FinReflectKG -- HalluBench:图式RAG幻觉基准测试用于金融问答系统
FinReflectKG -- HalluBench: GraphRAG Hallucination Benchmark for Financial Question Answering Systems
AI总结:
本文提出FinBench-QA-Hallucination基准测试,用于评估知识图谱增强金融问答系统中的幻觉检测方法,通过755个标注示例验证了LLM和嵌入方法的有效性,并揭示了现有系统的脆弱性。
摘要:
随着组织越来越多地将AI驱动的问答系统集成到金融信息系统中,确保AI生成输出的事实准确性成为关键工程挑战。当前的知识图谱(KG)增强问答系统缺乏系统机制来检测幻觉——事实性错误输出,这会削弱可靠性和用户信任。我们引入FinBench-QA-Hallucination,这是一个评估KG增强金融问答系统中幻觉检测方法的基准测试,涵盖SEC 10-K文件。数据集包含755个标注示例,来自300页,每个示例均通过保守的证据链接协议进行标注,需要文本片段和提取的三元组支持。我们评估了六种检测方法——LLM法官、微调分类器、自然语言推理(NLI)模型、跨度检测器和基于嵌入的方法,在两种条件下:有和无KG三元组。结果表明,在清洁条件下,基于LLM的法官和嵌入方法表现最佳(F1:0.82-0.86)。然而,当引入噪声三元组时,大多数方法显著退化, Matthews相关系数(MCC)下降44-84%,而嵌入方法相对稳健,仅下降9%。统计检验(Cochran's Q和McNemar)确认了显著的性能差异(p < 0.001)。我们的发现突显了当前KG增强系统中的脆弱性,并为构建可靠的金融信息系统提供了见解,其中幻觉可能导致监管违规和错误决策。该基准测试还提供了一个框架,用于在其他高风险领域如医疗、法律和政府中将AI可靠性评估整合到信息系统设计中。
英文摘要:
As organizations increasingly integrate AI-powered question-answering systems into financial information systems for compliance, risk assessment, and decision support, ensuring the factual accuracy of AI-generated outputs becomes a critical engineering challenge. Current Knowledge Graph (KG)-augmented QA systems lack systematic mechanisms to detect hallucinations - factually incorrect outputs that undermine reliability and user trust. We introduce FinBench-QA-Hallucination, a benchmark for evaluating hallucination detection methods in KG-augmented financial QA over SEC 10-K filings. The dataset contains 755 annotated examples from 300 pages, each labeled for groundedness using a conservative evidence-linkage protocol requiring support from both textual chunks and extracted relational triplets. We evaluate six detection approaches - LLM judges, fine-tuned classifiers, Natural Language Inference (NLI) models, span detectors, and embedding-based methods under two conditions: with and without KG triplets. Results show that LLM-based judges and embedding approaches achieve the highest performance (F1: 0.82-0.86) under clean conditions. However, most methods degrade significantly when noisy triplets are introduced, with Matthews Correlation Coefficient (MCC) dropping 44-84 percent, while embedding methods remain relatively robust with only 9 percent degradation. Statistical tests (Cochran's Q and McNemar) confirm significant performance differences (p < 0.001). Our findings highlight vulnerabilities in current KG-augmented systems and provide insights for building reliable financial information systems, where hallucinations can lead to regulatory violations and flawed decisions. The benchmark also offers a framework for integrating AI reliability evaluation into information system design across other high-stakes domains such as healthcare, legal, and government.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。