arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.10085cs.IRcs.LGcs.SI
收藏

审计YouTube的错误信息过滤气泡推荐算法

Auditing YouTube's Recommendation Algorithm for Misinformation Filter Bubbles

Kempelen Institute of Intelligent Technologies(凯梅伦智能技术研究所);Brno University of Technology(布尔诺理工大学)

Ivan Srba, Robert Moro, Matus Tomlein, Branislav Pecher, Jakub Simko, Elena Stefancova, Michal Kompan, Andrea Hrckova, Juraj Podrouzek, Adrian Gavornik, Maria Bielikova

摘要:

在本文中,我们介绍了在YouTube上进行的一项审计研究的结果,该研究旨在调查用户进入错误信息过滤器泡沫的速度,以及如何“打破泡沫”,即,恢复气泡罩。我们采用了一种傀儡审计方法,其中预编程的代理(作为YouTube用户)通过观看错误信息推广内容来深入研究错误信息过滤器泡沫。然后,他们试图通过观看错误信息揭穿内容来打破泡沫并获得更平衡的建议。我们会记录搜索结果、主页结果和观看视频的建议。总体而言,我们记录了17,405个独特的视频,其中我们手动注释了2,914个错误信息的存在。标记的数据用于训练机器学习模型,该模型将视频分类为三个类别(促进,揭穿,中性),准确率为0.82。我们使用经过训练的模型来对其余无法手动注释的视频进行分类。使用手动和自动注释的数据,我们观察了一系列审核主题的错误信息泡沫动态。我们的关键发现是,即使过滤气泡在某些情况下不会出现,当它们出现时,也可以通过观看错误信息揭穿内容来打破它们(尽管它在不同主题之间表现不同)。我们还观察到错误信息过滤器气泡效应的突然减少时,错误信息揭穿视频后,错误信息宣传视频观看,这表明一个强大的上下文的建议。最后,将我们的结果与以前的类似研究进行比较时,我们没有观察到推荐错误信息内容的总体数量有显着改善。

英文摘要:

In this paper, we present results of an auditing study performed over YouTube aimed at investigating how fast a user can get into a misinformation filter bubble, but also what it takes to "burst the bubble", i.e., revert the bubble enclosure. We employ a sock puppet audit methodology, in which pre-programmed agents (acting as YouTube users) delve into misinformation filter bubbles by watching misinformation promoting content. Then they try to burst the bubbles and reach more balanced recommendations by watching misinformation debunking content. We record search results, home page results, and recommendations for the watched videos. Overall, we recorded 17,405 unique videos, out of which we manually annotated 2,914 for the presence of misinformation. The labeled data was used to train a machine learning model classifying videos into three classes (promoting, debunking, neutral) with the accuracy of 0.82. We use the trained model to classify the remaining videos that would not be feasible to annotate manually. Using both the manually and automatically annotated data, we observe the misinformation bubble dynamics for a range of audited topics. Our key finding is that even though filter bubbles do not appear in some situations, when they do, it is possible to burst them by watching misinformation debunking content (albeit it manifests differently from topic to topic). We also observe a sudden decrease of misinformation filter bubble effect when misinformation debunking videos are watched after misinformation promoting videos, suggesting a strong contextuality of recommendations. Finally, when comparing our results with a previous similar study, we do not observe significant improvements in the overall quantity of recommended misinformation content.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑