arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.13554cs.HCcs.AI
收藏

邻家网红:虚假信息创作者如何使用生成式AI(GenAI)

The Influencer Next Door: How Misinformation Creators Use GenAI

University of Cambridge(剑桥大学)

Amelia Hassoun, Ariel Abonizio, Katy Osborn, Cameron Wu, Beth Goldberg

AI总结:

本研究通过2022-2023年的长期民族志调查,揭示非专业虚假信息创作者将GenAI用于拼贴创作、内容量产与变现的新模式,指出需转变研究视角并关注其带来的新型虚假信息危害与治理启示。

摘要:

生成式AI(GenAI)的发展引发了人们对检测与区分AI生成内容和人类生成内容的担忧。现有多数文献采用的范式是:“专业的”有组织虚假信息创作者与存在缺陷的AI模型欺骗“普通”用户。基于2022-2023年间对虚假信息创作者和消费者开展的长期民族志研究,我们反而发现GenAI支撑了拼贴创作(bricolage)工作,非专业人士越来越多地使用GenAI对内容进行混搭、重新包装和(再)制作,以满足个人需求与欲望。本研究得出四项关键发现:第一,参与者主要将GenAI用于创作,而非求真。第二,广为流传的“网红百万富翁”叙事驱使参与者成为内容创作者,他们将GenAI作为生产力工具,生成大量(往往带有虚假信息的)内容。第三,GenAI降低了跨模态内容创作的准入门槛,吸引消费者转变为创作者,并大幅提升了现有创作者的产出量。最后,参与者使用GenAI学习并运用营销策略,以扩大互动量并实现内容变现。我们主张将分析视角从“作为AI内容消费者的公众”转向“创造性使用GenAI的拼贴创作者(bricoleur)”——这类人群通常对GenAI的底层技术缺乏详细了解。我们分析了这些尚未被充分研究的GenAI新兴使用方式如何引发新的或被加速的虚假信息危害,以及它们对AI产品、平台和政策的启示。

英文摘要:

Advances in generative AI (GenAI) have raised concerns about detecting and discerning AI-generated content from human-generated content. Most existing literature assumes a paradigm where 'expert' organized disinformation creators and flawed AI models deceive 'ordinary' users. Based on longitudinal ethnographic research with misinformation creators and consumers between 2022-2023, we instead find that GenAI supports bricolage work, where non-experts increasingly use GenAI to remix, repackage, and (re)produce content to meet their personal needs and desires. This research yielded four key findings: First, participants primarily used GenAI for creation, rather than truth-seeking. Second, a spreading 'influencer millionaire' narrative drove participants to become content creators, using GenAI as a productivity tool to generate a volume of (often misinformative) content. Third, GenAI lowered the barrier to entry for content creation across modalities, enticing consumers to become creators and significantly increasing existing creators' output. Finally, participants used Gen AI to learn and deploy marketing tactics to expand engagement and monetize their content. We argue for shifting analysis from the public as consumers of AI content to bricoleurs who use GenAI creatively, often without a detailed understanding of its underlying technology. We analyze how these understudied emergent uses of GenAI produce new or accelerated misinformation harms, and their implications for AI products, platforms and policies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑