arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.00064cs.HC
收藏

决策系统的软件支持审计:测试谷歌和Facebook的政治广告政策

Software-Supported Audits of Decision-Making Systems: Testing Google and Facebook's Political Advertising Policies

J. Nathan Matias, Austin Hounsel, Nick Feamster

摘要:

社会如何理解复杂的人类和算法决策系统,并追究其责任,这些系统性错误对公众是不透明的?这些系统通常就个人权利和福祉以及保护社会和民主进程作出决定。外部审计的实际和统计限制-例如维度复杂性-可能导致研究人员和监管机构错过这些复杂决策系统中的重要错误来源。在本文中,我们设计和实现了一个软件支持的方法来审计研究,自动生成审计材料和协调志愿者活动。我们在Facebook和Google在2018年美国大选期间制定的政治广告政策中实施了该软件。在这个软件的指导下,一组志愿者发布了477个自动生成的广告,并分析了公司的行为,发现了公司执行政策的系统性错误。我们发现,软件可以克服一些常见的限制审计研究,在相关的样本量和志愿者的能力。

英文摘要:

How can society understand and hold accountable complex human and algorithmic decision-making systems whose systematic errors are opaque to the public? These systems routinely make decisions on individual rights and well-being, and on protecting society and the democratic process. Practical and statistical constraints on external audits--such as dimensional complexity--can lead researchers and regulators to miss important sources of error in these complex decision-making systems. In this paper, we design and implement a software-supported approach to audit studies that auto-generates audit materials and coordinates volunteer activity. We implemented this software in the case of political advertising policies enacted by Facebook and Google during the 2018 U.S. election. Guided by this software, a team of volunteers posted 477 auto-generated ads and analyzed the companies' actions, finding systematic errors in how companies enforced policies. We find that software can overcome some common constraints of audit studies, within limitations related to sample size and volunteer capacity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑