Automated Fact-Checking of Climate Change Claims with Large Language Models
University of Zürich（苏黎世大学）；Swiss Finance Institute（瑞士金融学院）；World Meteorological Organization（世界气象组织）；ETH Zürich（苏黎世联邦理工学院）；Swiss Federal Research Institute WSL（瑞士联邦森林、雪与景观研究所）；University of Oxford（牛津大学）；Council on Economic Policies（经济政策委员会）
Markus Leippold, Saeid Ashraf Vaghefi, Dominik Stammbach, Veruska Muccione, Julia Bingler, Jingwei Ni, Chiara Colesanti-Senni, Tobias Wekhof, Tobias Schimanski,… 展开作者
Markus Leippold, Saeid Ashraf Vaghefi, Dominik Stammbach, Veruska Muccione, Julia Bingler, Jingwei Ni, Chiara Colesanti-Senni, Tobias Wekhof, Tobias Schimanski, Glen Gostlow, Tingyu Yu, Juerg Luterbacher, Christian Huggel
This paper presents Climinator, a novel AI-based tool designed to automate the fact-checking of climate change claims. Utilizing an array of Large Language Models (LLMs) informed by authoritative sources like the IPCC reports and peer-reviewed scientific literature, Climinator employs an innovative Mediator-Advocate framework. This design allows Climinator to effectively synthesize varying scientific perspectives, leading to robust, evidence-based evaluations. Our model demonstrates remarkable accuracy when testing claims collected from Climate Feedback and Skeptical Science. Notably, when integrating an advocate with a climate science denial perspective in our framework, Climinator's iterative debate process reliably converges towards scientific consensus, underscoring its adeptness at reconciling diverse viewpoints into science-based, factual conclusions. While our research is subject to certain limitations and necessitates careful interpretation, our approach holds significant potential. We hope to stimulate further research and encourage exploring its applicability in other contexts, including political fact-checking and legal domains.
ClimateCheck 2026: Scientific Fact-Checking and Disinformation Narrative Classification of Climate-related Claims
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI)（德国人工智能研究中心）；Technische Universität Berlin（柏林工业大学）；Leuphana Universität Lüneburg（吕讷堡大学）；Humboldt-Universität zu Berlin（柏林洪堡大学）
Towards Comprehensive Stage-wise Benchmarking of Large Language Models in Fact-Checking
Department of Computer Science, Hong Kong Baptist University（香港 Baptist 大学计算机科学系）；Salesforce AI Research（Salesforce AI 研究院）；The Hong Kong University of Science and Technology（香港科学与技术大学）；National University of Singapore（新加坡国立大学）；The Education University of Hong Kong（香港教育大学）
Fact-Checking Complex Claims with Program-Guided Reasoning
University of California, Santa Barbara（加州大学圣巴巴拉分校）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Nanyang Technological University（南洋理工大学）；National University of Singapore（新加坡国立大学）
FAU Erlangen-Nuremberg（埃尔朗根-纽伦堡大学）；ETH Zurich（苏黎世联邦理工学院）；University of Zurich（苏黎世大学）
Over the recent years, large pretrained language models (LM) have revolutionized the field of natural language processing (NLP). However, while pretraining on general language has been shown to work very well for common language, it has been observed that niche language poses problems. In particular, climate-related texts include specific language that common LMs can not represent accurately. We argue that this shortcoming of today's LMs limits the applicability of modern NLP to the broad field of text processing of climate-related texts. As a remedy, we propose CLIMATEBERT, a transformer-base…
Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
Technische Universität Berlin（柏林工业大学）；Deutsches Forschungszentrum für Künstliche Intelligenz（德国人工智能研究中心）；National Institute of Informatics（信息学研究所）；Harz University of Applied Sciences（哈尔茨应用技术大学）
From Chaos to Clarity: Claim Normalization to Empower Fact-Checking
Indraprastha Institute of Information Technology Delhi（因德拉普拉斯塔信息技术学院德里校区）；Mohammed Bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Indian Institute of Technology Delhi（印度理工学院德里校区）
Saarland University（萨尔兰大学）；University of the Basque Country（巴斯克大学）；German Research Center for Artificial Intelligence, Saarland Informatics Campus（德国人工智能研究中心，萨尔兰信息学校区）；Faculty of Information Technology, Brno University of Technology（信息技术学院，布拉格技术大学）；Kempelen Institute of Intelligent Technologies（Kempelen智能技术研究所）
Facts are Harder Than Opinions -- A Multilingual, Comparative Analysis of LLM-Based Fact-Checking Reliability
GESIS – Leibniz Institute for the Social Sciences（GESIS社会科学院研究所）；RWTH Aachen University（亚琛RWTH大学）；University of Graz（格拉茨大学）；Complexity Science Hub（复杂性科学中心）
Evidence-backed Fact Checking using RAG and Few-Shot In-Context Learning with LLMs
IIT Kharagpur（印度理工学院克勒格布尔分校）；Aditya English Medium School（阿迪蒂亚英语中学）；UCLA（加利福尼亚大学洛杉矶分校）；Stanford University（斯坦福大学）；University of South Carolina（南卡罗来纳大学）；Amazon GenAI（亚马逊生成式AI部门）
Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantification
Center for Artificial Intelligence Technology（人工智能技术中心）；MBZUAI（穆罕默德·本·扎耶德人工智能大学）；AIRI（人工智能研究院）；FRC CSC RAS（俄罗斯科学院计算机科学与控制研究中心联邦研究中心）；The University of Melbourne（墨尔本大学）；QCRI（卡塔尔计算研究所）；HSE University（高等经济大学）
Hybrid Fact-Checking that Integrates Knowledge Graphs, Large Language Models, and Search-Based Retrieval Agents Improves Interpretable Claim Verification
Mila；McGill University（麦吉尔大学）；Université de Montréal（蒙特利尔大学）；Nord AI（北AI）；Harvard University（哈佛大学）；Supervised Program for Alignment Research (SPAR)（对齐研究监督计划）
University of Copenhagen（哥本哈根大学）；University of Washington（华盛顿大学）；Allen Institute for Artificial Intelligence（艾伦人工智能研究所）
Automated scientific fact checking is difficult due to the complexity of scientific language and a lack of significant amounts of training data, as annotation requires domain expertise. To address this challenge, we propose scientific claim generation, the task of generating one or more atomic and verifiable claims from scientific sentences, and demonstrate its usefulness in zero-shot fact checking for biomedical claims. We propose CLAIMGEN-BART, a new supervised method for generating claims supported by the literature, as well as KBIN, a novel method for generating claim negations. Additional…
Automated claim checking is the task of determining the veracity of a claim given evidence found in a knowledge base of trustworthy facts. While previous work has taken the knowledge base as given and optimized the claim-checking pipeline, we take the opposite approach - taking the pipeline as given, we explore the choice of knowledge base. Our first insight is that a claim-checking pipeline can be transferred to a new domain of claims with access to a knowledge base from the new domain. Second, we do not find a "universally best" knowledge base - higher domain overlap of a task dataset and a …
False medical information on social media poses harm to people's health. While the need for biomedical fact-checking has been recognized in recent years, user-generated medical content has received comparably little attention. At the same time, models for other text genres might not be reusable, because the claims they have been trained with are substantially different. For instance, claims in the SciFact dataset are short and focused: "Side effects associated with antidepressants increases risk of stroke". In contrast, social media holds naturally-occurring claims, often embedded in additiona…
School of Computing and Information Systems（计算与信息系统学院）；The University of Melbourne（墨尔本大学）
There is unison is the scientific community about human induced climate change. Despite this, we see the web awash with claims around climate change scepticism, thus driving the need for fact checking them but at the same time providing an explanation and justification for the fact check. Scientists and experts have been trying to address it by providing manually written feedback for these claims. In this paper, we try to aid them by automating generating explanation for a predicted veracity label for a claim by deploying the approach used in open domain question answering of a fusion in decod…
University of Stavanger（斯塔万格大学）；Max Planck Institute for Informatics（马克斯·普朗克信息研究所）；University of Zurich（苏黎世大学）
We present SUMO, a neural attention-based approach that learns to establish the correctness of textual claims based on evidence in the form of text documents (e.g., news articles or Web documents). SUMO further generates an extractive summary by presenting a diversified set of sentences from the documents that explain its decision on the correctness of the textual claim. Prior approaches to address the problem of fact checking and evidence extraction have relied on simple concatenation of claim and document word embeddings as an input to claim driven attention weight computation. This is done …
University of Michigan（密歇根大学）；Meedan（米丹）；MIT（麻省理工学院）；University of Oxford（牛津大学）
Manual fact-checking does not scale well to serve the needs of the internet. This issue is further compounded in non-English contexts. In this paper, we discuss claim matching as a possible solution to scale fact-checking. We define claim matching as the task of identifying pairs of textual messages containing claims that can be served with one fact-check. We construct a novel dataset of WhatsApp tipline and public group messages alongside fact-checked claims that are first annotated for containing "claim-like statements" and then matched with potentially similar items and annotated for claim …
Fact-checking requires retrieving evidence related to a claim under investigation. The task can be formulated as question generation based on a claim, followed by question answering. However, recent question generation approaches assume that the answer is known and typically contained in a passage given as input, whereas such passages are what is being sought when verifying a claim. In this paper, we present {\it Varifocal}, a method that generates questions based on different focal points within a given claim, i.e.\ different spans of the claim and its metadata, such as its source and date. O…
