arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.14828cs.CLcs.AI

CLEF-2025 CheckThat! 实验室:主观性、事实核查、主张规范化与检索

The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval

Qatar Computing Research Institute(卡塔尔计算研究所);University of Applied Sciences Potsdam(波茨坦应用科学大学);University of Bologna(博洛尼亚大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Indian Institute of Technology Delhi(印度理工学院德里分校);GESIS - Leibniz Institute for the Social Sciences(GESIS莱布尼茨社会科学研究所);Heinrich-Heine-University Düsseldorf(杜塞尔多夫海因里希·海涅大学);Delft University of Technology(代尔夫特理工大学);Indraprastha Institute of Information Technology(因德拉普拉斯塔信息技术学院);University of Montpellier(蒙彼利埃大学)
Firoj Alam, Julia Maria Struß, Tanmoy Chakraborty, Stefan Dietze, Salim Hafid, Katerina Korre, Arianna Muti, Preslav Nakov, Federico Ruggeri, Sebastian Schellha… 展开作者

Firoj Alam, Julia Maria Struß, Tanmoy Chakraborty, Stefan Dietze, Salim Hafid, Katerina Korre, Arianna Muti, Preslav Nakov, Federico Ruggeri, Sebastian Schellhammer, Vinay Setty, Megha Sundriyal, Konstantin Todorov, Venktesh V

AI总结:

CLEF-2025 CheckThat! 实验室延续反网络虚假信息的研究目标,设置主观性识别、主张规范化、数值主张事实核查、科学网络语篇处理四类任务,覆盖多语言场景下的文档与跨度级分类、检索问题,拓展信息验证相关研究边界。

摘要:

CheckThat! 实验室旨在推动创新技术的发展,这些技术用于识别并对抗多语言、多平台上的网络虚假信息和操纵行为。前5届赛事聚焦信息验证流程中的核心任务,包括可核查性评估、证据检索与配对、验证。自2023届起,实验室扩大了研究范围,新增支撑验证领域研究与决策的辅助任务。2025届赛事在重启核心验证任务的同时,也纳入了辅助挑战:任务1聚焦主观性识别(为CheckThat! 2024的延续任务),任务2针对主张规范化,任务3面向数值类主张的事实核查,任务4探索科学网络语篇处理。这些任务涵盖文档级和跨度级的分类与检索难题,涉及多语言场景。

英文摘要:

The CheckThat! lab aims to advance the development of innovative technologies designed to identify and counteract online disinformation and manipulation efforts across various languages and platforms. The first five editions focused on key tasks in the information verification pipeline, including check-worthiness, evidence retrieval and pairing, and verification. Since the 2023 edition, the lab has expanded its scope to address auxiliary tasks that support research and decision-making in verification. In the 2025 edition, the lab revisits core verification tasks while also considering auxiliary challenges. Task 1 focuses on the identification of subjectivity (a follow-up from CheckThat! 2024), Task 2 addresses claim normalization, Task 3 targets fact-checking numerical claims, and Task 4 explores scientific web discourse processing. These tasks present challenging classification and retrieval problems at both the document and span levels, including multilingual settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑