arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.09604cs.CL
收藏

从稀缺到能力:利用大型语言模型赋能低资源语言中的假新闻检测

From Scarcity to Capability: Empowering Fake News Detection in Low-Resource Languages with LLMs

Shahjalal University of Science and Technology(沙贾拉勒科技大学)

Hrithik Majumdar Shibu, Shrestha Datta, Md. Sumon Miah, Nasrullah Sami, Mahruba Sharmin Chowdhury, Md. Saiful Islam

AI总结:

针对孟加拉语低资源假新闻检测数据与工具不足的问题,本文构建 BanFakeNews-2.0 数据集与独立测试集,并结合 transformer 微调及 QLoRA 大模型建立高性能基准。

摘要:

假新闻的快速传播构成了一项重大的全球性挑战,尤其是在孟加拉语等低资源语言中,这些语言缺乏充足的数据集和检测工具。尽管人工事实核查是准确的,但其成本高昂且速度缓慢,无法阻止假新闻的传播。为弥补这一空白,我们推出了 BanFakeNews-2.0,这是一个用于增强孟加拉语假新闻检测的稳健数据集。该版本包含 11,700 篇额外的、经过精心整理并从可信来源验证的假新闻文章,形成了一个涵盖 13 个类别的均衡数据集,其中包括 47,000 条真实新闻和 13,000 条假新闻。此外,我们还创建了一个人工整理的独立测试集,包含 460 条假新闻和 540 条真实新闻,用于严格评估。我们投入精力从可信来源收集假新闻并进行人工验证,同时保留语言的丰富性。我们开发了一个基于 transformer 架构的基准系统,包括微调的 Bidirectional Encoder Representations from Transformers 变体(F1 为 87%)以及结合量化低秩近似的大型语言模型(F1 为 89%),其性能显著优于传统方法。BanFakeNews-2.0 为推进低资源语言假新闻检测的研究与应用提供了宝贵资源。我们在 GitHub 上公开发布数据集和模型,以推动这一方向的研究。

英文摘要:

The rapid spread of fake news presents a significant global challenge, particularly in low-resource languages like Bangla, which lack adequate datasets and detection tools. Although manual fact-checking is accurate, it is expensive and slow to prevent the dissemination of fake news. Addressing this gap, we introduce BanFakeNews-2.0, a robust dataset to enhance Bangla fake news detection. This version includes 11,700 additional, meticulously curated fake news articles validated from credible sources, creating a proportional dataset of 47,000 authentic and 13,000 fake news items across 13 categories. In addition, we created a manually curated independent test set of 460 fake and 540 authentic news items for rigorous evaluation. We invest efforts in collecting fake news from credible sources and manually verified while preserving the linguistic richness. We develop a benchmark system utilizing transformer-based architectures, including fine-tuned Bidirectional Encoder Representations from Transformers variants (F1-87\%) and Large Language Models with Quantized Low-Rank Approximation (F1-89\%), that significantly outperforms traditional methods. BanFakeNews-2.0 offers a valuable resource to advance research and application in fake news detection for low-resourced languages. We publicly release our dataset and model on Github to foster research in this direction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑