arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.09157cs.LGcs.CY
收藏

设计公平的算法

Designing Equitable Algorithms

Stanford University(斯坦福大学);Harvard University(哈佛大学)

Alex Chohlas-Wood, Madison Coots, Sharad Goel, Julian Nyarko

摘要:

预测算法现在用于帮助分配我们社会的大部分资源和制裁,例如医疗保健,贷款,刑事拘留和税务审计。在适当的情况下,这些算法可以提高决策的效率和公平性。与此同时,算法本身也有可能巩固和加剧差异,特别是种族、民族和性别方面的差异。为了确保算法的公平性,许多研究人员建议算法至少要受到以下三个约束之一的约束:(1)不使用受法律保护的特征,如种族、民族和性别;(2)各组之间“积极”决策的比率相等;(3)各组之间出错率相等。在这里,我们表明,这些限制,而直观的吸引力,往往恶化的结果,为个人在边缘化群体,甚至可以让所有群体更糟。我们在正式的公平约束和福利改善之间确定的固有权衡-特别是对于边缘化的人-突出了需要对算法“公平”意味着什么进行更有力的讨论。我们用医疗保健和刑事法律系统的例子来说明这些想法,并提出了一些建议,以帮助从业者设计更公平的算法。

英文摘要:

Predictive algorithms are now used to help distribute a large share of our society's resources and sanctions, such as healthcare, loans, criminal detentions, and tax audits. Under the right circumstances, these algorithms can improve the efficiency and equity of decision-making. At the same time, there is a danger that the algorithms themselves could entrench and exacerbate disparities, particularly along racial, ethnic, and gender lines. To help ensure their fairness, many researchers suggest that algorithms be subject to at least one of three constraints: (1) no use of legally protected features, such as race, ethnicity, and gender; (2) equal rates of "positive" decisions across groups; and (3) equal error rates across groups. Here we show that these constraints, while intuitively appealing, often worsen outcomes for individuals in marginalized groups, and can even leave all groups worse off. The inherent trade-off we identify between formal fairness constraints and welfare improvements -- particularly for the marginalized -- highlights the need for a more robust discussion on what it means for an algorithm to be "fair". We illustrate these ideas with examples from healthcare and the criminal-legal system, and make several proposals to help practitioners design more equitable algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑