在寻找更少歧视性算法中统计保证
Statistical Guarantees in the Search for Less Discriminatory Algorithms
AI总结:
本文研究了在高风险领域中,企业为减少对受保护群体的歧视性影响而寻找更少歧视性算法的统计保证问题,提出了一种自适应停止算法以确定何时停止搜索以证明进一步搜索不会带来有意义的改进。
摘要:
美国反歧视法可以对企业未能采用减少歧视的替代方案(LDA)施加责任:一种决策政策,能够在实现相同商业目标的同时减少对受法律保护群体的歧视性影响。最近的学术研究认为,这一学说对高风险领域(如就业、贷款和住房)的算法决策有直接影响,可能迫使企业寻找“更少歧视性算法”(Black等,2024)。监管机构有时会鼓励主动寻找LDA,强化了企业努力寻找同样表现但影响更小的模型的期望。模型多样性使得此类搜索成为可能:通过不同的随机种子重新训练可以产生具有相似预测性能但实质性不同的歧视性影响的模型。然而企业无法无限重新训练,这提出了一个核心问题:何时搜索足够证明善意?我们正式将LDA搜索在多样性下作为最优停止问题,其中开发者试图产生证据表明进一步搜索不太可能带来有意义的改进。我们的主要贡献是一种自适应停止算法,它提供了一个高概率的上界,以确定通过继续重新训练所能达到的最佳歧视性影响改进,使开发者能够证明(例如,向法院)进一步搜索不太可能有所帮助。我们还展示了在模型空间上更强的分布假设可以产生更紧的界限,并在现实世界信用和住房数据集上验证了该方法。
英文摘要:
U.S. discrimination law can impose liability on firms that fail to adopt a less discriminatory alternative (LDA): a decision policy that achieves the same business objectives while reducing disparate impact on legally protected groups. Recent scholarship argues that this doctrine has direct implications for algorithmic decision-making in high-stakes domains such as employment, lending, and housing, potentially obligating firms to search for "less discriminatory algorithms" (Black et al., 2024). Regulators have at times encouraged proactive LDA searches, reinforcing the expectation of a good-faith effort to identify equally performant models with lower disparate impact. Model multiplicity makes such searches plausible: retraining with different random seeds can yield models with comparable predictive performance but materially different disparate impacts. Yet firms cannot retrain indefinitely, raising a central question: when is the search sufficient to demonstrate good faith? We formalize LDA search under multiplicity as an optimal stopping problem in which a developer seeks to produce evidence that further search is unlikely to yield meaningful improvements. Our main contribution is an adaptive stopping algorithm that provides a high-probability upper bound on the best disparate-impact gains attainable through continued retraining, enabling developers to certify (e.g., to a court) that additional search is unlikely to help. We also show how stronger distributional assumptions over the model space can yield tighter bounds, and we validate the approach on real-world credit and housing datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。