如同抛硬币一样:人类对AI生成图像、视频、音频及音视频刺激的检测
As Good As A Coin Toss: Human detection of AI-generated images, videos, audio, and audiovisual stimuli
AI总结:
研究通过1276名参与者测试了人类区分真实与合成媒体的能力,发现人们在识别合成内容时表现接近随机水平,且合成内容、外语特征及单一模态会降低准确性,年龄也影响检测能力,凸显了对替代防护措施的迫切需求。
摘要:
当前对抗武器化合成媒体的主要防御手段之一是目标个体在遇到合成内容时能够视觉或听觉上识别其为AI生成。然而,随着合成媒体真实性的迅速提升,有必要准确了解人们当前对可能被说服的逼真但虚假内容的易受欺骗程度。我们通过1276名参与者进行感知研究,评估了人们区分真实与合成图像、音频、视频及音视频媒体的能力。我们发现,平均而言,人们难以区分合成与真实媒体,检测性能接近50%的随机水平。我们还发现,当刺激包含任何程度的合成内容、外语特征或媒体类型为单一模态时,准确性会降低。人们在识别包含人类面孔的合成图像时也较不准确,且当音频视频刺激的 authenticity 不同一时时也是如此。最后,我们发现对合成媒体的更高先前知识并不显著影响检测准确性,但年龄会影响,年长者比年轻者表现更差。这些结果表明,再依靠人类感知能力来保护自己免受武器化合成媒体威胁已不再可行,替代防护措施的需求比以往任何时候都更加紧迫。
英文摘要:
One of the current principal defenses against weaponized synthetic media continues to be the ability of the targeted individual to visually or auditorily recognize AI-generated content when they encounter it. However, as the realism of synthetic media continues to rapidly improve, it is vital to have an accurate understanding of just how susceptible people currently are to potentially being misled by convincing but false AI generated content. We conducted a perceptual study with 1276 participants to assess how capable people were at distinguishing between authentic and synthetic images, audio, video, and audiovisual media. We find that on average, people struggled to distinguish between synthetic and authentic media, with the mean detection performance close to a chance level performance of 50%. We also find that accuracy rates worsen when the stimuli contain any degree of synthetic content, features foreign languages, and the media type is a single modality. People are also less accurate at identifying synthetic images when they feature human faces, and when audiovisual stimuli have heterogeneous authenticity. Finally, we find that higher degrees of prior knowledgeability about synthetic media does not significantly impact detection accuracy rates, but age does, with older individuals performing worse than their younger counterparts. Collectively, these results highlight that it is no longer feasible to rely on the perceptual capabilities of people to protect themselves against the growing threat of weaponized synthetic media, and that the need for alternative countermeasures is more critical than ever before.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。