arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.09820cs.CYcs.LGcs.SI
收藏

机器制造媒体:监测机器生成文章在虚假信息与主流新闻网站上的动员

Machine-Made Media: Monitoring the Mobilization of Machine-Generated Articles on Misinformation and Mainstream News Websites

Stanford University(斯坦福大学)

Hans W. A. Hanley, Zakir Durumeric

AI总结:

本研究首次大规模监测机器生成新闻,发现2022至2023年间虚假信息网站合成文章激增474%,主流网站增57.3%,且增长集中于小网站,ChatGPT发布加剧此现象。

摘要:

随着像ChatGPT这样的大型语言模型(LLMs)日益普及,越来越多的新闻网站开始利用它们来生成文章。然而,这些语言模型不仅可能在知名网站上产生事实不准确的报道,而且声誉不佳的新闻网站也能利用LLMs大规模制造虚假信息。为了初步理解这一现象,我们提出了在线新闻媒体中合成文章普遍性的首批大规模研究之一。为此,我们训练了一个基于DeBERTa的合成新闻检测器,并对来自3,074个虚假信息和主流新闻网站的超过1,546万篇文章进行了分类。我们发现,在2022年1月1日至2023年5月1日期间,主流网站上合成新闻文章的相对数量增加了57.3%,而在虚假信息网站上则增加了474%。我们发现,这一增长主要由规模较小、不太受欢迎的网站推动。通过使用中断时间序列分析ChatGPT发布的影响,我们表明,尽管其发布导致小型网站以及虚假信息新闻网站上的合成文章显著增加,但在大型主流新闻网站上并未出现相应的增长。

英文摘要:

As large language models (LLMs) like ChatGPT have gained traction, an increasing number of news websites have begun utilizing them to generate articles. However, not only can these language models produce factually inaccurate articles on reputable websites but disreputable news sites can utilize LLMs to mass produce misinformation. To begin to understand this phenomenon, we present one of the first large-scale studies of the prevalence of synthetic articles within online news media. To do this, we train a DeBERTa-based synthetic news detector and classify over 15.46 million articles from 3,074 misinformation and mainstream news websites. We find that between January 1, 2022, and May 1, 2023, the relative number of synthetic news articles increased by 57.3% on mainstream websites while increasing by 474% on misinformation sites. We find that this increase is largely driven by smaller less popular websites. Analyzing the impact of the release of ChatGPT using an interrupted-time-series, we show that while its release resulted in a marked increase in synthetic articles on small sites as well as misinformation news websites, there was not a corresponding increase on large mainstream news websites.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑