arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1704.03354stat.MLcs.CYcs.ITmath.IT
收藏

用于防止歧视的优化数据预处理

Optimized Data Pre-Processing for Discrimination Prevention

Flavio P. Calmon, Dennis Wei, Karthikeyan Natesan Ramamurthy, Kush R. Varshney

摘要:

非歧视是算法决策中公认的目标。在本文中,我们介绍了一种新的概率公式的数据预处理,以减少歧视。我们提出了一个凸优化学习的数据转换有三个目标:控制歧视,限制个别数据样本的失真,并保持效用。我们的特点有限的样本量在实现这一目标的影响,并应用两个实例的建议优化数据集,包括一个现实世界的刑事累犯。结果表明,所有三个标准可以同时实现,也揭示了在美国社会的偏见有趣的模式。

英文摘要:

Non-discrimination is a recognized objective in algorithmic decision making. In this paper, we introduce a novel probabilistic formulation of data pre-processing for reducing discrimination. We propose a convex optimization for learning a data transformation with three goals: controlling discrimination, limiting distortion in individual data samples, and preserving utility. We characterize the impact of limited sample size in accomplishing this objective, and apply two instances of the proposed optimization to datasets, including one on real-world criminal recidivism. The results demonstrate that all three criteria can be simultaneously achieved and also reveal interesting patterns of bias in American society.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑