arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.11358cs.CY
收藏

文本到图像生成中的性别偏见评估:综述

Gender Bias Evaluation in Text-to-image Generation: A Survey

Yankun Wu, Yuta Nakashima, Noa Garcia

AI总结:

本文综述了文本到图像生成中的性别偏见评估,涵盖评估设置、指标及趋势,重点分析Stable Diffusion和DALL-E 2等模型,为未来研究提供见解。

摘要:

文本到图像生成的快速发展带来了日益增长的伦理考量,尤其是关于性别偏见的问题。给定文本提示作为输入,文本到图像模型根据提示生成图像。诸如Stable Diffusion和DALL-E 2等先驱模型已展现出从自然语言提示生成高保真图像的卓越能力。然而,这些模型常常表现出性别偏见,例如从“一位软件开发者的照片”等提示中倾向于生成男性图像。鉴于这些模型的广泛应用和日益增长的可及性,偏见评估对于规范文本到图像生成的发展至关重要。与评估图像质量或保真度的成熟指标不同,偏见评估面临挑战且缺乏标准方法。尽管与肤色等其他因素相关的偏见已被探索,但性别偏见仍是研究最为广泛的。在本文中,我们回顾了文本到图像生成中性别偏见评估的最新工作,涉及偏见评估设置、偏见评估指标以及发现与趋势。我们主要关注近期流行模型的评估,如Stable Diffusion(一种在潜在空间中运行并使用CLIP文本嵌入的扩散模型)和DALL-E 2(一种利用Seq2Seq架构如BART的扩散模型)。通过分析近期工作并讨论趋势,我们旨在为未来工作提供见解。

英文摘要:

The rapid development of text-to-image generation has brought rising ethical considerations, especially regarding gender bias. Given a text prompt as input, text-to-image models generate images according to the prompt. Pioneering models such as Stable Diffusion and DALL-E 2 have demonstrated remarkable capabilities in producing high-fidelity images from natural language prompts. However, these models often exhibit gender bias, as studied by the tendency of generating man from prompts such as "a photo of a software developer". Given the widespread application and increasing accessibility of these models, bias evaluation is crucial for regulating the development of text-to-image generation. Unlike well-established metrics for evaluating image quality or fidelity, the evaluation of bias presents challenges and lacks standard approaches. Although biases related to other factors, such as skin tone, have been explored, gender bias remains the most extensively studied. In this paper, we review recent work on gender bias evaluation in text-to-image generation, involving bias evaluation setup, bias evaluation metrics, and findings and trends. We primarily focus on the evaluation of recent popular models such as Stable Diffusion, a diffusion model operating in the latent space and using CLIP text embedding, and DALL-E 2, a diffusion model leveraging Seq2Seq architectures like BART. By analyzing recent work and discussing trends, we aim to provide insights for future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑