arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.12715cs.LGcs.AI
收藏

通过超参数优化促进公平性

Promoting Fairness through Hyperparameter Optimization

Feedzai(Feedzai公司);Universidade do Porto(波尔图大学)

André F. Cruz, Pedro Saleiro, Catarina Belém, Carlos Soares, Pedro Bizarro

摘要:

相当多的研究工作已被引导到算法公平性,但在现实世界中采用的偏见减少技术仍然是稀缺的。现有的方法要么是度量或模型特定的,需要在推理时访问敏感的属性,或携带高的开发或部署成本。这项工作探讨了仅为预测性能而优化ML模型时出现的不公平性,以及如何通过简单且易于部署的干预来减轻这种不公平性:公平感知超参数优化(HO)。我们提出并评估了三种流行的HO算法的公平性感知变体:公平随机搜索,公平TPE和Fairband。我们验证了我们的方法在现实世界中的银行开户欺诈案例研究,以及公平性文献的三个数据集。结果表明,在没有额外训练成本的情况下,与公平盲HO相比,可以找到平均公平性增加111%,性能仅下降6%的模型。

英文摘要:

Considerable research effort has been guided towards algorithmic fairness but real-world adoption of bias reduction techniques is still scarce. Existing methods are either metric- or model-specific, require access to sensitive attributes at inference time, or carry high development or deployment costs. This work explores the unfairness that emerges when optimizing ML models solely for predictive performance, and how to mitigate it with a simple and easily deployed intervention: fairness-aware hyperparameter optimization (HO). We propose and evaluate fairness-aware variants of three popular HO algorithms: Fair Random Search, Fair TPE, and Fairband. We validate our approach on a real-world bank account opening fraud case-study, as well as on three datasets from the fairness literature. Results show that, without extra training cost, it is feasible to find models with 111% mean fairness increase and just 6% decrease in performance when compared with fairness-blind HO.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑