Hybrid Fact-Checking that Integrates Knowledge Graphs, Large Language Models, and Search-Based Retrieval Agents Improves Interpretable Claim Verification
Technical University Munich(慕尼黑工业大学)
Shaghayegh Kolli, Richard Rosenbaum, Timo Cavelius, Lasse Strothe, Andrii Lata, Jana Diesner
备注:
Paper has been accepted at 9th wiNLP workshop at EMNLP
Large language models (LLMs) excel in generating fluent utterances but can lack reliable grounding in verified information. At the same time, knowledge-graph-based fact-checkers deliver precise and interpretable evidence, yet suffer from limited coverage or latency. By integrating LLMs with knowledge graphs and real-time search agents, we introduce a hybrid fact-checking approach that leverages the individual strengths of each component. Our system comprises three autonomous steps: 1) a Knowledge Graph (KG) Retrieval for rapid one-hop lookups in DBpedia, 2) an LM-based classification guided by a task-specific labeling prompt, producing outputs with internal rule-based logic, and 3) a Web Search Agent invoked only when KG coverage is insufficient. Our pipeline achieves an F1 score of 0.93 on the FEVER benchmark on the Supported/Refuted split without task-specific fine-tuning. To address Not enough information cases, we conduct a targeted reannotation study showing that our approach frequently uncovers valid evidence for claims originally labeled as Not Enough Information (NEI), as confirmed by both expert annotators and LLM reviewers. With this paper, we present a modular, opensource fact-checking pipeline with fallback strategies and generalization across datasets.
BiDeV: Bilateral Defusing Verification for Complex Claim Fact-Checking
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Nankai University(南开大学);Baidu Inc.(百度公司);Kunming University of Science and Technology(昆明理工大学)
Fact-Checking Complex Claims with Program-Guided Reasoning
University of California, Santa Barbara(加州大学圣巴巴拉分校);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学)
Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
Technische Universität Berlin(柏林工业大学);Deutsches Forschungszentrum für Künstliche Intelligenz(德国人工智能研究中心);National Institute of Informatics(信息学研究所);Harz University of Applied Sciences(哈尔茨应用技术大学)
From Chaos to Clarity: Claim Normalization to Empower Fact-Checking
Indraprastha Institute of Information Technology Delhi(因德拉普拉斯塔信息技术学院德里校区);Mohammed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Indian Institute of Technology Delhi(印度理工学院德里校区)
Towards Comprehensive Stage-wise Benchmarking of Large Language Models in Fact-Checking
Department of Computer Science, Hong Kong Baptist University(香港 Baptist 大学计算机科学系);Salesforce AI Research(Salesforce AI 研究院);The Hong Kong University of Science and Technology(香港科学与技术大学);National University of Singapore(新加坡国立大学);The Education University of Hong Kong(香港教育大学)
Facts are Harder Than Opinions -- A Multilingual, Comparative Analysis of LLM-Based Fact-Checking Reliability
GESIS – Leibniz Institute for the Social Sciences(GESIS社会科学院研究所);RWTH Aachen University(亚琛RWTH大学);University of Graz(格拉茨大学);Complexity Science Hub(复杂性科学中心)
LLM-Orchestrated Conformance Checking in Stroke Care Without Computer-Interpretable Guidelines
Computer Science Institute, DiSIT, University of Piemonte Orientale(皮埃蒙特东方大学计算机科学研究所);Integrated Laboratory of AI and Medical Informatics, DAIRI, SS. Antonio e Biagio e Cesare Arrigo Hospital(圣安东尼奥、比亚焦与切萨雷·阿里戈医院DAIRI人工智能与医学信息学综合实验室)
Automated Fact-Checking of Climate Change Claims with Large Language Models
University of Zürich(苏黎世大学);Swiss Finance Institute(瑞士金融学院);World Meteorological Organization(世界气象组织);ETH Zürich(苏黎世联邦理工学院);Swiss Federal Research Institute WSL(瑞士联邦森林、雪与景观研究所);University of Oxford(牛津大学);Council on Economic Policies(经济政策委员会)
ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)(德国人工智能研究中心);Technische Universität Berlin(柏林工业大学);Leuphana Universität Lüneburg(吕讷堡大学);Humboldt-Universität zu Berlin(柏林洪堡大学)
Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs
IIT Kharagpur(印度理工学院克勒格布尔分校);Aditya English Medium School(阿迪蒂亚英语中学);UCLA(加利福尼亚大学洛杉矶分校);Stanford University(斯坦福大学);University of South Carolina(南卡罗来纳大学);Amazon GenAI(亚马逊生成式AI部门)
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification
Center for Artificial Intelligence Technology(人工智能技术中心);MBZUAI(穆罕默德·本·扎耶德人工智能大学);AIRI(人工智能研究院);FRC CSC RAS(俄罗斯科学院计算机科学与控制研究中心联邦研究中心);The University of Melbourne(墨尔本大学);QCRI(卡塔尔计算研究所);HSE University(高等经济大学)
To mitigate the impact of the scarcity of labelled data on fact-checking systems, we focus on few-shot claim verification. Despite recent work on few-shot classification by proposing advanced language models, there is a dearth of research in data annotation prioritisation that improves the selection of the few shots to be labelled for optimal model performance. We propose Active PETs, a novel weighted approach that utilises an ensemble of Pattern Exploiting Training (PET) models based on various language models, to actively select unlabelled data as candidates for annotation. Using Active PETs…
Mila;McGill University(麦吉尔大学);Université de Montréal(蒙特利尔大学);Nord AI(北AI);Harvard University(哈佛大学);Supervised Program for Alignment Research (SPAR)(对齐研究监督计划)
Assessing the Potential of Generative Agents in Crowdsourced Fact-Checking
Department of Electrical Engineering and Information Technology (DIETI), University of Naples Federico II(那不勒斯费德里科二世大学电气工程与信息技术系);Northwestern University, Department of Computer Science, McCormick School of Engineering and Applied Science(西北大学计算机科学系,麦科马克工程与应用科学学院)
Saarland University(萨尔兰大学);University of the Basque Country(巴斯克大学);German Research Center for Artificial Intelligence, Saarland Informatics Campus(德国人工智能研究中心,萨尔兰信息学校区);Faculty of Information Technology, Brno University of Technology(信息技术学院,布拉格技术大学);Kempelen Institute of Intelligent Technologies(Kempelen智能技术研究所)