arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.06273cs.LGcs.CYq-fin.ST
收藏

通过模型和数据偏差相互作用理解欺诈检测中的不公平性

Understanding Unfairness in Fraud Detection through Model and Data Bias Interactions

Feedzai(Feedzai公司);Instituto Superior Técnico(高等技术学院);Instituto de Telecomunicações(电信研究所)

José Pombal, André F. Cruz, João Bravo, Pedro Saleiro, Mário A. T. Figueiredo, Pedro Bizarro

摘要:

近年来,机器学习算法在众多高风险决策应用中变得无处不在。机器学习算法从数据中学习模式的无与伦比的能力也使它们能够将偏见嵌入其中。一个有偏见的模型可以做出不成比例地伤害社会中某些群体的决定-例如,限制他们获得金融服务。对这一问题的认识已经引起了公平ML领域的兴起,该领域专注于研究、测量和减轻算法预测中关于一组受保护组(例如,种族或性别)。然而,算法不公平的根本原因仍然难以捉摸,研究人员在归咎于ML算法或它们训练的数据之间存在分歧。在这项工作中,我们认为算法不公平源于模型之间的相互作用和数据中的偏见,而不是来自其中任何一个的孤立贡献。为此,我们提出了一种分类来表征数据偏差,并研究了一组关于公平盲ML算法在不同数据偏差设置下表现出的公平-准确性权衡的假设。在我们真实的开户欺诈用例中,我们发现每个设置都需要特定的权衡,影响期望值和方差的公平性-后者通常被忽视。此外,我们还展示了算法在准确性和公平性方面的不同比较,这取决于影响数据的偏见。最后,我们注意到,在特定的数据偏差条件下,简单的预处理干预可以成功地平衡组的出错率,而同样的技术在更复杂的设置失败。

英文摘要:

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society -- limiting their access to financial services, for example. The awareness of this problem has given rise to the field of Fair ML, which focuses on studying, measuring, and mitigating unfairness in algorithmic prediction, with respect to a set of protected groups (e.g., race or gender). However, the underlying causes for algorithmic unfairness still remain elusive, with researchers divided between blaming either the ML algorithms or the data they are trained on. In this work, we maintain that algorithmic unfairness stems from interactions between models and biases in the data, rather than from isolated contributions of either of them. To this end, we propose a taxonomy to characterize data bias and we study a set of hypotheses regarding the fairness-accuracy trade-offs that fairness-blind ML algorithms exhibit under different data bias settings. On our real-world account-opening fraud use case, we find that each setting entails specific trade-offs, affecting fairness in expected value and variance -- the latter often going unnoticed. Moreover, we show how algorithms compare differently in terms of accuracy and fairness, depending on the biases affecting the data. Finally, we note that under specific data bias conditions, simple pre-processing interventions can successfully balance group-wise error rates, while the same techniques fail in more complex settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑