T2IBias:揭示文本到图像生成模型潜在空间中编码的社会偏见
T2IBias: Uncovering Societal Bias Encoded in the Latent Space of Text-to-Image Generative Models
AI总结:
本研究调查了社会偏见在T2I模型预训练潜在空间中的编码情况,通过对五个开源模型的实证分析,发现其均存在种族和性别相关偏差,为负责任AI实践提供了模型选择与偏见缓解的关键见解。
摘要:
文本到图像(T2I)生成模型被广泛应用于人工智能驱动的现实世界应用和价值创造中。然而,其战略性部署引发了负责任人工智能管理的关键担忧,特别是关于种族和性别相关刻板印象的再现与放大,这可能会破坏组织伦理。在本研究中,我们调查了此类社会偏见是否系统地编码在最先进T2I模型的预训练潜在空间中。我们对五个最受欢迎的开源模型进行了实证研究,使用十个中性的、与职业相关的提示词,每个职业生成100张图像,最终形成一个包含5000张图像的数据集,并由代表不同种族和性别的多样化人类评估者进行评估。我们证明所有五个模型都编码并放大了显著的社会偏差:护理和看护角色持续被女性化,而企业CEO、政治家、医生和律师等高地位职业则绝大多数由男性和主要是白人个体代表。我们进一步识别了模型特定的模式,例如QWEN-Image几乎只关注东亚输出,Kandinsky以白人个体为主,而SDXL的分布相对更广泛但仍存在偏见。这些结果为人工智能项目经理和从业者提供了关键见解,使他们能够选择公平的人工智能模型和定制提示词,生成符合负责任人工智能原则的图像。最后,我们讨论了这些偏见的风险,并提出了在构建负责任生成式人工智能系统中减轻偏见的可操作策略。代码和数据仓库:https://github.com/Sufianlab/T2IBias
英文摘要:
Text-to-image (T2I) generative models are largely used in AI-powered real-world applications and value creation. However, their strategic deployment raises critical concerns for responsible AI management, particularly regarding the reproduction and amplification of race- and gender-related stereotypes that can undermine organizational ethics. In this work, we investigate whether such societal biases are systematically encoded within the pretrained latent spaces of state-of-the-art T2I models. We conduct an empirical study across the five most popular open-source models, using ten neutral, profession-related prompts to generate 100 images per profession, resulting in a dataset of 5,000 images evaluated by diverse human assessors representing different races and genders. We demonstrate that all five models encode and amplify pronounced societal skew: caregiving and nursing roles are consistently feminized, while high-status professions such as corporate CEO, politician, doctor, and lawyer are overwhelmingly represented by males and mostly White individuals. We further identify model-specific patterns, such as QWEN-Image's near-exclusive focus on East Asian outputs, Kandinsky's dominance of White individuals, and SDXL's comparatively broader but still biased distributions. These results provide critical insights for AI project managers and practitioners, enabling them to select equitable AI models and customized prompts that generate images in alignment with the principles of responsible AI. We conclude by discussing the risks of these biases and proposing actionable strategies for bias mitigation in building responsible GenAI systems. The code and Data Repository: https://github.com/Sufianlab/T2IBias
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。