Work integrating conversations around AI and Disability is vital and valued, particularly when done through a lens of fairness. Yet at the same time, analyzing the ethical implications of AI for disabled people solely through the lens of a singular idea of "fairness" risks reinforcing existing power dynamics, either through reinforcing the position of existing medical gatekeepers, or promoting tools and techniques that benefit otherwise-privileged disabled people while harming those who are rendered outliers in multiple ways. In this paper we present two case studies from within computer vision - a subdiscipline of AI focused on training algorithms that can "see" - of technologies putatively intended to help disabled people but, through failures to consider structural injustices in their design, are likely to result in harms not addressed by a "fairness" framing of ethics. Drawing on disability studies and critical data science, we call on researchers into AI ethics and disability to move beyond simplistic notions of fairness, and towards notions of justice.
Algorithmic Fairness and Structural Injustice: Insights from Feminist Political Philosophy
数据驱动的预测算法被广泛用于自动化和指导高风险决策,如保释和假释建议,医疗资源分配和抵押贷款分配。然而,也有报告称,出现了不利于弱势群体的有害结果。被称为“算法公平性”的不断发展的研究领域旨在减轻这些有害的偏见。它的主要方法包括提出数学指标,以解决算法有偏见的输出所造成的社会危害。这些衡量标准通常是由政治和法律哲学家制定的分配正义的理想所推动的,或者说是植根于这种理想。相比之下,女性主义政治哲学家关于社会正义的观点在很大程度上被忽视了。一些女性主义哲学家批评了分配正义的范式,并提出了纠正修正案,以克服其局限性。本文将女性主义政治哲学的一些重要观点引入算法公平性。该文件有三个目标。首先,我表明,算法公平性并不适应其目前的范围内的结构性不公正。第二,我捍卫结构性不公正的相关性--正如Iris Marion Young在当代哲学文献中所开创的那样--与算法公平性的相关性。第三,我采取了一些步骤,在发展的范式“负责任的算法公平性”,以纠正错误的算法公平性的当前范围和实施。
Blind Justice: Fairness with Encrypted Sensitive Attributes
University of Cambridge(剑桥大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);The Alan Turing Institute(艾伦·图灵研究所);University of Warwick(华威大学);University College London(伦敦大学学院);Max Planck Institute for Software Systems(马克斯·普朗克软件系统研究所)
Case Study: Predictive Fairness to Reduce Misdemeanor Recidivism Through Social Service Interventions
Carnegie Mellon University(卡内基梅隆大学);Ctr for Data Science & Public Policy , University of Chicago(芝加哥大学数据科学与公共政策中心);Los Angeles City Attorney’s Office(洛杉矶市检察官办公室);Heinz College of Information Systems & Public Policy , Carnegie Mellon University(卡内基梅隆大学海因茨信息系统与公共政策学院);Machine Learning Department , Carnegie Mellon University(卡内基梅隆大学机器学习系);Director, Recidivism Reduction and Drug Diversion Unit (R2D2) , Los Angeles City Attorney’s Office(洛杉矶市检察官办公室再犯率降低和药物分流部门主任(R2D2))
From Network Inequality to Network Fairness: A Perspective on Responsible Decision-Making
Complexity Science Hub Vienna(维也纳复杂性科学中心);Northeastern University(东北大学);Santa Fe Institute(圣塔菲研究所);Hong Kong Baptist University(香港浸会大学);Vienna University of Technology(维也纳工业大学);KTH Royal Institute of Technology(KTH皇家理工学院);Universitat Pompeu Fabra(庞培法布拉大学);Brown University(布朗大学);Graz University of Technology(格拉茨工业大学)
Algorithmic Unfairness through the Lens of EU Non-Discrimination Law: Or Why the Law is not a Decision Tree
Eindhoven University of Technology(埃因霍温理工大学);Sciences Po Law School(巴黎政治学院法学院);CNRS(法国国家科学研究中心);ENS Paris-Saclay(巴黎萨克雷高等师范学院);University of Copenhagen(哥本哈根大学)