区分结果测验中的边缘性问题
The Problem of Infra-marginality in Outcome Tests for Discrimination
摘要:
结果测试是一种流行的方法,用于检测贷款,招聘和监管决策中的偏见。这些测试通过比较各组决策的成功率来进行。例如,如果观察到向少数群体申请人提供的贷款比向白人申请人提供的贷款偿还得更多,这表明只有特别合格的少数群体才能获得贷款,这表明存在歧视。然而,结果测试,是众所周知的,从亚边缘化的问题:即使没有歧视,还款率为少数民族和白人贷款接受者可能会有所不同,如果这两个群体有不同的风险分布。因此,至少在理论上,结果测试可能无法准确检测歧视。我们开发了一个新的统计测试的歧视-阈值测试-减轻问题的超边际通过联合估计决策阈值和风险分布,通过一个分层贝叶斯潜变量模型。将我们的测试应用于北卡罗来纳州450万警察站的数据集,我们发现超边缘性问题不仅仅是一个理论上的可能性,而且可能导致结果测试在实践中产生误导性的结果。
英文摘要:
Outcome tests are a popular method for detecting bias in lending, hiring, and policing decisions. These tests operate by comparing the success rate of decisions across groups. For example, if loans made to minority applicants are observed to be repaid more often than loans made to whites, it suggests that only exceptionally qualified minorities are granted loans, indicating discrimination. Outcome tests, however, are known to suffer from the problem of infra-marginality: even absent discrimination, the repayment rates for minority and white loan recipients might differ if the two groups have different risk distributions. Thus, at least in theory, outcome tests can fail to accurately detect discrimination. We develop a new statistical test of discrimination---the threshold test---that mitigates the problem of infra-marginality by jointly estimating decision thresholds and risk distributions via a hierarchical Bayesian latent variable model. Applying our test to a dataset of 4.5 million police stops in North Carolina, we find that the problem of infra-marginality is more than a theoretical possibility, and can cause the outcome test to yield misleading results in practice.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。