审计方法如何影响我们对YouTube推荐系统的理解
How Auditing Methodologies Can Impact Our Understanding of YouTube's Recommendation Systems
AI总结:
本文探讨了审计方法对YouTube推荐系统理解的影响,指出审计配置的选择在减少经济和计算开销的同时不影响推断准确性。
摘要:
由社交媒体网站审计生成的数据已成为我们理解算法内容推荐系统中偏见的基础。随着全球各地的立法者开始考虑对驱动在线平台的算法系统进行监管,确保这些推断偏见的正确性至关重要。然而,正如本文所展示的,这一任务由于与从特定平台收集数据的审计相关的配置参数的复杂性有关,因此是一个具有挑战性的任务。专注于YouTube,我们表明,为了推断YouTube的推荐系统,进行审计比人们预期的更具方法学挑战性。为了获得科学上有效果的结果,需要考虑许多方法学决定,而每个决定都会产生成本。例如,审计人员在收集算法推荐时应使用(昂贵获取)登录的YouTube账户以获得更准确的推断吗?我们探索了这一以及其他决定的影响,并发现了一些关于影响YouTube推荐的方法学选择的令人惊讶的发现。综合来看,我们的研究建议审计配置妥协,这些妥协可以帮助YouTube审计人员和研究人员减少审计开销,无论是经济上还是计算上,而不牺牲推断的准确性。同样,我们还识别出几个对测量推断准确性有显著影响的配置参数,这些参数应被仔细考虑。
英文摘要:
Data generated by audits of social media websites have formed the basis of our understanding of the biases presented in algorithmic content recommendation systems. As legislators around the world are beginning to consider regulating the algorithmic systems that drive online platforms, it is critical to ensure the correctness of these inferred biases. However, as we will show in this paper, doing so is a challenging task for a variety of reasons related to the complexity of configuration parameters associated with the audits that gather data from a specific platform. Focusing specifically on YouTube, we show that conducting audits to make inferences about YouTube's recommendation systems is more methodologically challenging than one might expect. There are many methodological decisions that need to be considered in order to obtain scientifically valid results, and each of these decisions incur costs. For example, should an auditor use (expensive to obtain) logged-in YouTube accounts while gathering recommendations from the algorithm to obtain more accurate inferences? We explore the impact of this and many other decisions and make some startling discoveries about the methodological choices that impact YouTube's recommendations. Taken all together, our research suggests auditing configuration compromises that YouTube auditors and researchers can use to reduce audit overhead, both economically and computationally, without sacrificing accuracy of their inferences. Similarly, we also identify several configuration parameters that have a significant impact on the accuracy of measured inferences and should be carefully considered.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。