在本文中,我们通过对算法审计领域权力不对称的批判性反思,参与并扩展了 Christian Sandvig 教授在 IC2S2 2021 上关于审计权的主旨演讲。我们详细阐述了 Sandvig 提到的挑战与不对称——例如与法律问题相关的挑战,以及早期职业研究者与资深研究者之间的差距。我们还对 Sandvig 未涉及但我们认为至关重要的不对称进行了讨论:包括研究者之间的其他差距、与获取公司数据相关的激励结构、审计对象与用户及其权利之间的不对称。我们还讨论了这些不对称对算法审计研究的影响,例如西方中心主义和视角多样性的缺乏。虽然我们特别聚焦于算法审计领域,但我们认为所讨论的某些不对称在更广泛的 Computational Social Science 中也存在影响,需要加以反思和解决。
英文摘要:
In this paper, we engage with and expand on the keynote talk about the Right to Audit given by Prof. Christian Sandvig at the IC2S2 2021 through a critical reflection on power asymmetries in the algorithm auditing field. We elaborate on the challenges and asymmetries mentioned by Sandvig - such as those related to legal issues and the disparity between early-career and senior researchers. We also contribute a discussion of the asymmetries that were not covered by Sandvig but that we find critically important: those related to other disparities between researchers, incentive structures related to the access to data from companies, targets of auditing and users and their rights. We also discuss the implications these asymmetries have for algorithm auditing research such as the Western-centrism and the lack of the diversity of perspectives. While we focus on the field of algorithm auditing specifically, we suggest some of the discussed asymmetries affect Computational Social Science more generally and need to be reflected on and addressed.
Learning About Algorithm Auditing in Five Steps: Scaffolding How High School Youth Can Systematically and Critically Evaluate Machine Learning Applications
University of Pennsylvania(宾夕法尼亚大学);Teachers College, Columbia University(哥伦比亚大学教师学院)
Oxford Internet Institute, University of Oxford(牛津大学牛津互联网研究院);Digital Ethics Center, Yale University(耶鲁大学数字伦理中心);Harvard Law School(哈佛大学法学院);Center for Information Technology Policy, Princeton University(普林斯顿大学信息技术政策中心)
Technion - Israel Institute of Technology(以色列理工学院);ALTER (Association for Long Term Existence and Resilience)(ALTER(长期存在与韧性协会));Transformative Futures Institute(变革性未来研究所);National Intelligence University(国家情报大学)
Compliant But Unsatisfactory: The Gap Between Auditing Standards and Practices for Probabilistic Genotyping Software
University of California, Berkeley(加州大学伯克利分校);Wright State University(莱特州立大学);Forensic Bioinformatic Services, Inc.(法医生物信息学服务公司);ELLIS Institute(ELLIS研究所);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Auditing large language models: a three-layered approach
University of Oxford(牛津大学);Princeton University(普林斯顿大学);Centre for the Governance of AI(人工智能治理中心);Goethe University Frankfurt(法兰克福歌德大学);University of Bologna(博洛尼亚大学)