arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.04815cs.CLcs.AI
收藏

LiveFact:一种动态、时间感知的LLM驱动虚假新闻检测基准

LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection

University College Dublin(都柏林大学);Georgia Institute of Technology(佐治亚理工学院);Dalian University of Technology(大连理工大学);Bebxy(贝比)

Cheng Xu, Changhong Jin, Yingjie Niu, Nan Yan, Yuke Mei, Shuhao Guan, Liming Chen, M-Tahar Kechadi

AI总结:

LiveFact引入动态时间感知基准,评估模型在处理演进不完整信息时的推理能力,发现传统静态基准无法检测的推理差距。

摘要:

大型语言模型(LLM)的快速发展使虚假新闻检测任务从简单分类转变为复杂推理。然而,评估框架未能同步发展。当前基准静态,易受基准数据污染(BDC)影响,无法有效评估时间不确定性下的推理能力。为此,我们引入LiveFact,一个持续更新的基准,模拟现实世界中的

英文摘要:

The rapid development of Large Language Models (LLMs) has transformed fake news detection and fact-checking tasks from simple classification to complex reasoning. However, evaluation frameworks have not kept pace. Current benchmarks are static, making them vulnerable to benchmark data contamination (BDC) and ineffective at assessing reasoning under temporal uncertainty. To address this, we introduce LiveFact a continuously updated benchmark that simulates the real-world "fog of war" in misinformation detection. LiveFact uses dynamic, temporal evidence sets to evaluate models on their ability to reason with evolving, incomplete information rather than on memorized knowledge. We propose a dual-mode evaluation: Classification Mode for final verification and Inference Mode for evidence-based reasoning, along with a component to monitor BDC explicitly. Tests with 22 LLMs show that open-source Mixture-of-Experts models, such as Qwen3-235B-A22B, now match or outperform proprietary state-of-the-art systems. More importantly, our analysis finds a significant "reasoning gap." Capable models exhibit epistemic humility by recognizing unverifiable claims in early data slices-an aspect traditional static benchmarks overlook. LiveFact sets a sustainable standard for evaluating robust, temporally aware AI verification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑