arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.11277cs.CLcs.AI
收藏

证据稀缺下的实时假新闻检测

Towards Real-Time Fake News Detection under Evidence Scarcity

Nanjing University(南京大学);Ocean University of China(海洋大学);University of Trento(特伦托大学);Chinese Academy of Sciences(中国科学院)

Guangyu Wei, Ke Han, Yueming Lyu, Yu Luo, Yue Jiang, Caifeng Shan, Nicu Sebe

AI总结:

针对实时场景下证据稀缺导致假新闻检测泛化难的问题,提出框架EASE,通过包含证据、推理和情感回退的顺序评估机制动态调整决策,并引入新基准RealTimeNews-25,实现了最先进的检测性能与泛化能力。

摘要:

在实时场景中,假新闻检测变得尤为具有挑战性,因为新出现的事件往往缺乏足够的支持证据。现有方法严重依赖外部证据,因此在证据稀缺时难以泛化。为解决此问题,我们提出了EASE(Evaluation-Aware Selection of Experts,评估感知专家选择),这是一个用于实时假新闻检测的新颖框架,它根据对可用证据充分性的评估,动态调整其决策过程。EASE引入了一个包含三个独立视角的顺序评估机制:(1)基于证据的评估,仅在证据具有足够支持性时才评估证据并将其纳入决策;(2)基于推理的评估,利用大型语言模型(LLMs)的世界知识,并仅在其可靠性得到充分确立时才应用它们;(3)基于情感的回退,当证据和推理都不可靠时整合情感线索。为提高评估过程的准确性,EASE采用带有伪标签的指令微调,引导每个评估器通过可解释的推理来论证其特定视角的知识。此外,专家模块将评估器经过论证的评估与新闻内容相结合,实现评估感知的决策,从而提高整体检测准确性。此外,我们引入了RealTimeNews-25,这是一个包含近期新闻的新基准,用于评估模型在证据有限的新兴新闻上的泛化能力。大量实验表明,EASE不仅在多个基准上实现了最先进的性能,而且显著提高了对实时新闻的泛化能力。代码和数据集可用:https://github.com/wgyhhhh/EASE。

英文摘要:

Fake news detection becomes particularly challenging in real-time scenarios, where emerging events often lack sufficient supporting evidence. Existing approaches often rely heavily on external evidence and therefore struggle to generalize under evidence scarcity. To address this issue, we propose Evaluation-Aware Selection of Experts (EASE), a novel framework for real-time fake news detection that dynamically adapts its decision-making process according to the assessed sufficiency of available evidence. EASE introduces a sequential evaluation mechanism comprising three independent perspectives: (1) Evidence-based evaluation, which assesses evidence and incorporates it into decision-making only when the evidence is sufficiently supportive; (2) Reasoning-based evaluation, which leverages the world knowledge of large language models (LLMs) and applies them only when their reliability is adequately established; and (3) Sentiment-based fallback, which integrates sentiment cues when neither evidence nor reasoning is reliable. To enhance the accuracy of evaluation processes, EASE employs instruction tuning with pseudo labels to guide each evaluator in justifying its perspective-specific knowledge through interpretable reasoning. Furthermore, the expert modules integrate the evaluators' justified assessments with the news content to enable evaluation-aware decision-making, thereby enhancing overall detection accuracy. Moreover, we introduce RealTimeNews-25, a new benchmark comprising recent news for evaluating model generalization on emerging news with limited evidence. Extensive experiments demonstrate that EASE not only achieves state-of-the-art performance across multiple benchmarks, but also significantly improves generalization to real-time news. The code and dataset are available: https://github.com/wgyhhhh/EASE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑