arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.03092cs.LGecon.GNq-fin.ECstat.ML
收藏

揭开机器偏见的根源

Uncovering the Source of Machine Bias

Carnegie Mellon University(卡内基梅隆大学)

Xiyang Hu, Yan Huang, Beibei Li, Tian Lu

摘要:

我们开发了一个结构计量经济学模型来捕捉在线小额贷款平台上人类评估者的决策动态,并使用真实世界的数据集估计模型参数。我们发现两种类型的性别偏见,基于偏好的偏见和基于信念的偏见,存在于人类评估者的决定。这两种偏见都有利于女性申请人。通过反事实模拟,我们量化了性别偏见对贷款发放结果以及公司和借款人福利的影响。我们的研究结果表明,基于偏好的偏见和基于信念的偏见的存在降低了公司的利润。当基于偏好的偏见被消除时,公司赚取更多的利润。当基于信念的偏见被消除时,公司的利润也会增加。这两种增长都是由于提高了借款人,特别是男性借款人的批准概率,他们最终会偿还贷款。对借款人而言,消除其中任何一种偏见都会缩小信贷风险评估中真阳性率的性别差距。我们还对真实世界数据和来自反事实模拟的数据进行训练机器学习算法。我们比较了这些算法所做的决定,看看评估者的偏见是如何被算法继承并反映在基于机器的决策中的。我们发现,机器学习算法可以减轻基于偏好的偏见和基于信念的偏见。

英文摘要:

We develop a structural econometric model to capture the decision dynamics of human evaluators on an online micro-lending platform, and estimate the model parameters using a real-world dataset. We find two types of biases in gender, preference-based bias and belief-based bias, are present in human evaluators' decisions. Both types of biases are in favor of female applicants. Through counterfactual simulations, we quantify the effect of gender bias on loan granting outcomes and the welfare of the company and the borrowers. Our results imply that both the existence of the preference-based bias and that of the belief-based bias reduce the company's profits. When the preference-based bias is removed, the company earns more profits. When the belief-based bias is removed, the company's profits also increase. Both increases result from raising the approval probability for borrowers, especially male borrowers, who eventually pay back loans. For borrowers, the elimination of either bias decreases the gender gap of the true positive rates in the credit risk evaluation. We also train machine learning algorithms on both the real-world data and the data from the counterfactual simulations. We compare the decisions made by those algorithms to see how evaluators' biases are inherited by the algorithms and reflected in machine-based decisions. We find that machine learning algorithms can mitigate both the preference-based bias and the belief-based bias.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑