arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.15567cs.CYcs.AIcs.CLcs.LG
收藏

向AI寻求薪资谈判建议是一个值得关注的问题:在无明确标准答案的情境任务中对ChatGPT开展受保护与非受保护群体歧视的受控实验扰动研究

Asking an AI for salary negotiation advice is a matter of concern: Controlled experimental perturbation of ChatGPT for protected and non-protected group discrimination on a contextual task with no clear ground truth answers

Halıcıoğlu Data Science Institute, University of California, San Diego(加州大学圣迭戈分校哈利西奥卢数据科学学院);Department of Communication, University of California, San Diego(加州大学圣迭戈分校传播系)

R. Stuart Geiger, Flynn O'Sullivan, Elsie Wang, Jonathan Lo

AI总结:

本研究通过对四个版本ChatGPT提交98800条不同属性的薪资谈判开价提示,发现模型在性别、院校、专业等属性上存在不一致的偏见,为AI公平性审计提供了无标准答案情境下的新研究视角。

摘要:

我们对四个版本的ChatGPT开展了受控实验偏见审计,要求其为新员工推荐薪资谈判的开价。我们向每个版本提交了98800条提示,系统地改变员工的性别、毕业院校和专业,并分别以谈判双方(员工方与雇主方)的口吻测试提示。我们发现,作为多模型平台的ChatGPT不够稳健和一致,不足以胜任此类任务。\n我们观察到,在所有四个模型中,改变性别会导致统计上显著的薪资开价差异,尽管差距小于其他测试属性。最大的差距出现在不同模型版本之间,以及员工方与雇主方口吻的提示之间。我们还发现,改变院校和专业时存在显著差距,但许多偏见在不同模型版本间并不一致。我们测试了虚构和欺诈性院校,发现不同案例和模型版本的结果差异极大。\n我们为AI/ML公平性文献做出了更广泛的贡献。我们的场景和实验设计在关键方面与主流AI/ML审计工作不同:偏见审计通常测试性别等受保护类别的歧视,而我们将其与院校和专业等非受保护类别的测试进行对比。寻求谈判建议包括一个人在谈判中相对于已知经验薪资分布和规模应采取的激进程度,这是一项高度情境化和个性化的任务,没有客观的标准答案可供验证。这些结果引发了对我们测试的特定模型版本,以及作为持续开发中多模型平台的ChatGPT的担忧。我们的认识论不允许我们明确证明这些模型在我们测试的属性上总体存在偏见或无偏见,但我们的研究提出了值得利益相关者进一步调查的关注事项。

英文摘要:

We conducted controlled experimental bias audits for four versions of ChatGPT, which we asked to recommend an opening offer in salary negotiations for a new hire. We submitted 98,800 prompts to each version, systematically varying the employee's gender, university, and major, and tested prompts in voice of each side of the negotiation: the employee versus employer. We find ChatGPT as a multi-model platform is not robust and consistent enough to be trusted for such a task. We observed statistically significant salary offers when varying gender for all four models, although with smaller gaps than for other attributes tested. The largest gaps were different model versions and between the employee- vs employer-voiced prompts. We also observed substantial gaps when varying university and major, but many of the biases were not consistent across model versions. We tested for fictional and fraudulent universities and found wildly inconsistent results across cases and model versions. We make broader contributions to the AI/ML fairness literature. Our scenario and our experimental design differ from mainstream AI/ML auditing efforts in key ways. Bias audits typically test discrimination for protected classes like gender, which we contrast with testing non-protected classes of university and major. Asking for negotiation advice includes how aggressive one ought to be in a negotiation relative to known empirical salary distributions and scales, which is a deeply contextual and personalized task that has no objective ground truth to validate. These results raise concerns for the specific model versions we tested and ChatGPT as a multi-model platform in continuous development. Our epistemology does not permit us to definitively certify these models as either generally biased or unbiased on the attributes we test, but our study raises matters of concern for stakeholders to further investigate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑