arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.10329cs.CYcs.AI
收藏

生成式歧视:当生成式AI表现出偏见时会发生什么,以及可以采取什么措施

Generative Discrimination: What Happens When Generative AI Exhibits Bias, and What Can Be Done About It

Philipp Hacker

AI总结:

本章探讨了生成式AI加剧歧视的风险,将歧视性输出分为贬损内容与代表性不足的隐蔽偏见,主张更新欧盟法律(如《AI法案》)以强制测试审计并追究提供者责任。

摘要:

随着生成式人工智能(genAI)技术在各行业普及,它们带来了显著益处,但也面临加剧歧视的风险。本章探讨了genAI如何与非歧视法交叉,指出了其中的不足并提出了改进建议。它重点介绍了两类主要的歧视性输出:(i)贬损和辱骂性内容,以及(ii)由于对受保护群体代表性不足而产生的更隐蔽的偏见,这些偏见在个案中可能并不具有明显的歧视性,但具有累积的歧视效应。例如,当被要求生成重要职位的人物图像时,genAI系统可能主要描绘白人男性。本章审视了这些问题,将有问题的输出分为三个法律类别:歧视性内容;骚扰;以及法律上的疑难案件,如内容不平衡、有害刻板印象或错误分类。它主张应让genAI的提供者和部署者对歧视性输出承担责任,并强调传统法律框架在处理genAI特定问题上的不足。本章建议更新欧盟法律,包括《AI法案》,以减轻训练和输入数据中的偏见,强制要求进行测试和审计,并随着技术进步完善立法,以执行偏见减轻和包容性标准。

英文摘要:

As generative Artificial Intelligence (genAI) technologies proliferate across sectors, they offer significant benefits but also risk exacerbating discrimination. This chapter explores how genAI intersects with non-discrimination laws, identifying shortcomings and suggesting improvements. It highlights two main types of discriminatory outputs: (i) demeaning and abusive content and (ii) subtler biases due to inadequate representation of protected groups, which may not be overtly discriminatory in individual cases but have cumulative discriminatory effects. For example, genAI systems may predominantly depict white men when asked for images of people in important jobs. This chapter examines these issues, categorizing problematic outputs into three legal categories: discriminatory content; harassment; and legally hard cases like unbalanced content, harmful stereotypes or misclassification. It argues for holding genAI providers and deployers liable for discriminatory outputs and highlights the inadequacy of traditional legal frameworks to address genAI-specific issues. The chapter suggests updating EU laws, including the AI Act, to mitigate biases in training and input data, mandating testing and auditing, and evolving legislation to enforce standards for bias mitigation and inclusivity as technology advances.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑