风险评估工具中的公平性:后处理以实现反事实的均衡赔率
Fairness in Risk Assessment Instruments: Post-Processing to Achieve Counterfactual Equalized Odds
摘要:
在刑事司法、医学和社会福利等领域,决策者越来越多地使用算法风险评估工具(RAI)。RAIs评估不良后果的风险,如累犯或忽视儿童,可能为高风险的决定提供信息,如是否保释被告或启动儿童福利调查。重要的是要确保RAIs是公平的,以便公平地分配这些决定的利益和危害。最广泛使用的算法公平性标准是针对可观察的结果制定的,例如一个人是否真的再犯,但这些标准在应用于RAI时具有误导性。由于RAIs旨在为可以降低风险的干预措施提供信息,因此预测本身会影响下游结果。最近的工作认为,区域审计机构的公平标准应该利用潜在的结果,即在没有适当干预的情况下会发生的结果。然而,目前还不存在满足这种公平标准的方法。在本文中,我们针对这样一个标准,反事实均衡赔率。我们开发了一个后处理的预测,估计通过双鲁棒估计,扩展和适应以前的后处理方法的反事实设置。我们还提供了双鲁棒估计的风险和公平性的任意固定后处理的预测。我们的预测收敛到一个最佳的公平的预测在快速的速度。我们说明了我们的方法的属性,并表明它表现良好的模拟和真实数据。
英文摘要:
In domains such as criminal justice, medicine, and social welfare, decision makers increasingly have access to algorithmic Risk Assessment Instruments (RAIs). RAIs estimate the risk of an adverse outcome such as recidivism or child neglect, potentially informing high-stakes decisions such as whether to release a defendant on bail or initiate a child welfare investigation. It is important to ensure that RAIs are fair, so that the benefits and harms of such decisions are equitably distributed. The most widely used algorithmic fairness criteria are formulated with respect to observable outcomes, such as whether a person actually recidivates, but these criteria are misleading when applied to RAIs. Since RAIs are intended to inform interventions that can reduce risk, the prediction itself affects the downstream outcome. Recent work has argued that fairness criteria for RAIs should instead utilize potential outcomes, i.e. the outcomes that would occur in the absence of an appropriate intervention. However, no methods currently exist to satisfy such fairness criteria. In this paper, we target one such criterion, counterfactual equalized odds. We develop a post-processed predictor that is estimated via doubly robust estimators, extending and adapting previous post-processing approaches to the counterfactual setting. We also provide doubly robust estimators of the risk and fairness properties of arbitrary fixed post-processed predictors. Our predictor converges to an optimal fair predictor at fast rates. We illustrate properties of our method and show that it performs well on both simulated and real data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。