arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2507.02152cs.AI
收藏

公平的幻象:利用审计研究审计公平性干预措施

The Illusion of Fairness: Auditing Fairness Interventions with Audit Studies

Disa Sariola, Patrick Button, Aron Culotta, Nicholas Mattei

AI总结:

本文利用审计研究数据揭示传统公平性干预在招聘算法中的虚假公平现象,并提出基于个体处理效应估计的新干预方法以进一步减少算法歧视。

摘要:

人工智能系统,尤其是那些使用机器学习的系统,正被部署在从招聘到贷款发放等领域,以实现这些复杂决策的自动化。评判这些人工智能系统及其人类决策对应方的有效性和公平性,是一个复杂且重要的课题,在计算科学和社会科学领域均有研究。在机器学习中,解决下游分类器偏差的一种常见方法是对训练数据进行重采样,以抵消差异。例如,如果招聘率因某些受保护类别而异,那么可以在训练集内均衡该比率,以减轻所得分类器中的偏差。尽管这些方法简单且看似有效,但通常仅使用通过便利样本获得的数据进行评估,从而在指标中引入选择偏差和标签偏差。在社会科学、心理学、公共卫生和医学领域,审计研究通过在随机对照试验中将虚构的“测试者”(例如简历、电子邮件、患者演员)发送给对象(例如职位空缺、企业、医生),提供了高质量的数据,支持对歧视的严格估计。在本文中,我们研究了如何利用审计研究的数据来提高我们训练和评估自动化招聘算法的能力。我们发现,此类数据揭示了以下情况:常见的公平性干预方法——在不同类别之间均衡基准率——在使用传统度量时似乎实现了平等,但在适当度量时实际上存在约10%的差异。此外,我们引入了基于个体处理效应估计方法的干预措施,利用这些数据进一步减少了算法歧视。

英文摘要:

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI systems, and their human decision making counterpart, is a complex and important topic studied across both computational and social sciences. Within machine learning, a common way to address bias in downstream classifiers is to resample the training data to offset disparities. For example, if hiring rates vary by some protected class, then one may equalize the rate within the training set to alleviate bias in the resulting classifier. While simple and seemingly effective, these methods have typically only been evaluated using data obtained through convenience samples, introducing selection bias and label bias into metrics. Within the social sciences, psychology, public health, and medicine, audit studies, in which fictitious ``testers'' (e.g., resumes, emails, patient actors) are sent to subjects (e.g., job openings, businesses, doctors) in randomized control trials, provide high quality data that support rigorous estimates of discrimination. In this paper, we investigate how data from audit studies can be used to improve our ability to both train and evaluate automated hiring algorithms. We find that such data reveals cases where the common fairness intervention method of equalizing base rates across classes appears to achieve parity using traditional measures, but in fact has roughly 10% disparity when measured appropriately. We additionally introduce interventions based on individual treatment effect estimation methods that further reduce algorithmic discrimination using this data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑