arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.07139cs.LGcs.AI
收藏

跨模型公平性:模型多样性下公平性与伦理的实证研究

Cross-model Fairness: Empirical Study of Fairness and Ethics Under Model Multiplicity

ARC Centre of Excellence for Automated Decision-Making and Society(自动化决策与社会卓越研究中心);RMIT University(皇家墨尔本理工大学);ETH Zurich(苏黎世联邦理工学院);Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究所);UNSW Sydney(新南威尔士大学悉尼分校)

Kacper Sokol, Meelis Kull, Jeffrey Chan, Flora Salim

AI总结:

该研究提出跨模型公平性的新定义,指出从性能等效的模型中任选预测器可能损害个体公平,经实证研究发现此类不公平普遍存在且仅靠技术手段难以缓解,否则会降低预测性能。

摘要:

尽管数据驱动的预测模型本质上是纯技术产物,但它们可能在社会环境中运行,其中看似无害的工程选择会带来隐性、间接且意料之外的现实后果。这类系统的公平性——既涉及个体也涉及群体——是该领域的一个相关考量因素;算法可能基于各种受保护特征对人群造成歧视,无论这些特征是否被纳入数据,或是能通过代理变量被识别。截至目前,这一概念主要针对固定模型展开研究,通常在不同的分类阈值下进行,旨在识别并消除其运行中不受欢迎的、带有歧视性的、甚至可能违法的问题。\n在此,我们摒弃这种固定模型假设,提出并探索一种“跨模型公平性”的新定义:当从一组性能相当的模型中(即基于效用的模型多样性场景下)临时选择某个预测器时,个体可能会受到损害。由于一个人在其他方面被认为等效的不同模型中可能得到不同的分类结果,该个体可能会主张采用能给自己带来最有利结果的预测器,而这样做可能会对其他人产生不利影响。\n我们通过一个二维示例和线性分类引入这一场景;随后,基于算法公平领域常用的真实预测模型和数据集开展了全面的实证研究;最后,我们探究了跨模型公平性的分析性质及其在更广泛背景下的影响。我们的研究结果表明,这类不公平现象在现实中很容易出现,且仅靠技术手段可能难以缓解,因为这样做大概率会降低预测性能。

英文摘要:

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such systems -- pertaining both to individuals and groups -- is one relevant consideration in this space; algorithms can discriminate people across various protected characteristics regardless of whether these properties are included in the data or discernible through proxy variables. To date, this notion has predominantly been studied for a fixed model, often under different classification thresholds, striving to identify and eradicate undesirable, discriminative and possibly unlawful aspects of its operation. Here, we backtrack on this fixed model assumption to propose and explore a novel definition of cross-model fairness where individuals can be harmed when one predictor is chosen ad hoc from a group of equally well performing models, i.e., in view of utility-based model multiplicity. Since a person may be classified differently across models that are otherwise considered equivalent, this individual could argue for a predictor granting them the most favourable outcome, employing which may have adverse effects on other people. We introduce this scenario with a two-dimensional example and linear classification; then, we present a comprehensive empirical study based on real-life predictive models and data sets that are popular with the algorithmic fairness community; finally, we investigate analytical properties of cross-model fairness and its ramifications in a broader context. Our findings suggest that such unfairness can be readily found in real life and it may be difficult to mitigate by technical means alone as doing so is likely to degrade predictive performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑