arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.04174cs.AI
收藏

CoALFake:协作主动学习与人类-大语言模型共注释用于跨领域假新闻检测

CoALFake: Collaborative Active Learning with Human-LLM Co-Annotation for Cross-Domain Fake News Detection

University of Montreal(蒙特利尔大学)

Esma Aïmeur, Gilles Brassard, Dorsaf Sallami

AI总结:

本文提出CoALFake,通过人类与大语言模型共注释和领域感知主动学习,解决跨领域假新闻检测中数据获取困难和领域特征丢失的问题,实验显示其在多个数据集上表现优异。

摘要:

虚假新闻在不同领域中的传播凸显了当前检测系统的关键局限,这些系统通常具有狭窄的领域特异性和较差的泛化能力。现有的跨领域方法面临两个关键挑战:(1)依赖标记数据,这些数据通常不可用且获取成本高昂;(2)由于刚性的领域分类或忽视领域特定特征导致的信息丢失。为了解决这些问题,我们提出了CoALFake,一种新的跨领域虚假新闻检测方法,结合了人类-大语言模型(LLM)共同注释与领域感知主动学习(AL)。我们的方法利用LLM进行可扩展、低成本的注释,同时保持人类监督以确保标签可靠性。通过整合领域嵌入技术,CoALFake动态捕捉领域特定的细微差别和跨领域的模式,从而训练出领域无关的模型。此外,一种领域感知的采样策略通过优先考虑多样化的领域覆盖来优化样本获取。在多个数据集上的实验结果表明,所提出的方法在多个数据集上均优于各种基线方法。我们的结果强调,人类-LLM共同注释是一种高度成本效益的方法,能够提供出色的性能。在多个数据集上的评估表明,CoALFake在最小的人类监督下也 consistently 超过了现有的各种基线方法。

英文摘要:

The proliferation of fake news across diverse domains highlights critical limitations in current detection systems, which often exhibit narrow domain specificity and poor generalization. Existing cross-domain approaches face two key challenges: (1) reliance on labelled data, which is frequently unavailable and resource intensive to acquire and (2) information loss caused by rigid domain categorization or neglect of domain-specific features. To address these issues, we propose CoALFake, a novel approach for cross-domain fake news detection that integrates Human-Large Language Model (LLM) co-annotation with domain-aware Active Learning (AL). Our method employs LLMs for scalable, low-cost annotation while maintaining human oversight to ensure label reliability. By integrating domain embedding techniques, the CoALFake dynamically captures both domain specific nuances and cross-domain patterns, enabling the training of a domain agnostic model. Furthermore, a domain-aware sampling strategy optimizes sample acquisition by prioritizing diverse domain coverage. Experimental results across multiple datasets demonstrate that the proposed approach consistently outperforms various baselines. Our results emphasize that human-LLM co-annotation is a highly cost-effective approach that delivers excellent performance. Evaluations across several datasets show that CoALFake consistently outperforms a range of existing baselines, even with minimal human oversight.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑