arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.12594cs.LGcs.AI
收藏

定向偏置放大

Directional Bias Amplification

Princeton University(普林斯顿大学)

Angelina Wang, Olga Russakovsky

摘要:

减轻机器学习系统中的偏见需要完善我们对偏见传播途径的理解:从社会结构到大规模数据,再到经过训练的模型对社会的影响。在这项工作中,我们专注于问题的一个方面,即偏差放大:模型放大其训练数据中存在的偏差的趋势。Zhao et al.(2017)在开创性的工作中引入了一种衡量偏差放大的指标。然而,正如我们所证明,该度量具有许多缺点,包括合并不同类型的偏置放大以及不能考虑受保护属性的变化的基本速率。我们介绍和分析了一种新的,去耦度量测量偏置放大,$\text{BiasAmp}_{\rightarrow}$(定向偏置放大)。我们彻底分析和讨论这一指标的技术假设和规范的影响。我们提供了有关其测量的建议,警告不要预测敏感属性,鼓励使用置信区间,由于在运行中的模型的公平性波动,并讨论了这个度量捕获的局限性。在本文中,我们的工作提供了一个疑问看技术测量的偏见放大,我们希望它包括我们的规范性思想的指导下。代码位于https://github.com/princetonvisualai/directional-bias-amp

英文摘要:

Mitigating bias in machine learning systems requires refining our understanding of bias propagation pathways: from societal structures to large-scale data to trained models to impact on society. In this work, we focus on one aspect of the problem, namely bias amplification: the tendency of models to amplify the biases present in the data they are trained on. A metric for measuring bias amplification was introduced in the seminal work by Zhao et al. (2017); however, as we demonstrate, this metric suffers from a number of shortcomings including conflating different types of bias amplification and failing to account for varying base rates of protected attributes. We introduce and analyze a new, decoupled metric for measuring bias amplification, $\text{BiasAmp}_{\rightarrow}$ (Directional Bias Amplification). We thoroughly analyze and discuss both the technical assumptions and normative implications of this metric. We provide suggestions about its measurement by cautioning against predicting sensitive attributes, encouraging the use of confidence intervals due to fluctuations in the fairness of models across runs, and discussing the limitations of what this metric captures. Throughout this paper, we work to provide an interrogative look at the technical measurement of bias amplification, guided by our normative ideas of what we want it to encompass. Code is located at https://github.com/princetonvisualai/directional-bias-amp

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑