arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.19981cs.CV
收藏

“人”等于浅肤色西方男性与有色人种女性的性化:Stable Diffusion中的刻板印象

'Person' == Light-skinned, Western Man, and Sexualization of Women of Color: Stereotypes in Stable Diffusion

University of Washington(华盛顿大学)

Sourojit Ghosh, Aylin Caliskan

AI总结:

本文通过136个提示词分析Stable Diffusion的刻板印象,发现其将“人”默认为欧洲/北美男性、抹去原住大洋洲人民并过度性化部分有色人种女性,揭示了该模型延续西方偏见与物化的问题。

摘要:

我们研究最流行的文本到图像生成器之一Stable Diffusion中嵌入的刻板印象。我们考察在缺乏性别和国籍/大陆身份信息的情况下,Stable Diffusion会表现出怎样的性别和国籍/大陆身份刻板印象,即“一个人”或“一个来自亚洲的人”会被赋予怎样的性别和国籍/大陆身份。我们使用视觉语言模型CLIP的余弦相似度来比较由基于CLIP的Stable Diffusion v2.1生成的图像,并通过人工检查进行验证,记录了来自136个提示(每个提示50个结果)的结果,这些提示涉及来自6个不同大洲、27个国籍和3种性别的正面人物图像。我们观察到,Stable Diffusion在没有任何额外性别/国籍信息的情况下输出的“一个人”与男性图像最接近,与非二元性别者最不接近,并且与欧洲/北美人士的接近程度高于非洲/亚洲人士,这表明Stable Diffusion对“人”的呈现存在令人担忧的问题,即将其呈现为欧洲/北美男性。我们还展示了大洲刻板印象及其造成的伤害,例如,来自大洋洲的人被认为更可能是澳大利亚/新西兰人而非巴布亚新几内亚人,这表明原住大洋洲人民被抹去,而他们在巴布亚新几内亚以及整个大洋洲都占多数,超过殖民者后裔。最后,我们意外地观察到一种女性被过度性化的模式,具体而言,相对于其他国籍,拉丁美洲、墨西哥、印度和埃及女性被过度性化,这是通过NSFW检测器测量得出的。这表明Stable Diffusion通过媒体中的物化延续了西方对有色人种女性的恋物化,如果不加以制止,将放大这种刻板印象化的呈现。图像数据集已公开发布。

英文摘要:

We study stereotypes embedded within one of the most popular text-to-image generators: Stable Diffusion. We examine what stereotypes of gender and nationality/continental identity does Stable Diffusion display in the absence of such information i.e. what gender and nationality/continental identity is assigned to `a person', or to `a person from Asia'. Using vision-language model CLIP's cosine similarity to compare images generated by CLIP-based Stable Diffusion v2.1 verified by manual examination, we chronicle results from 136 prompts (50 results/prompt) of front-facing images of persons from 6 different continents, 27 nationalities and 3 genders. We observe how Stable Diffusion outputs of `a person' without any additional gender/nationality information correspond closest to images of men and least with persons of nonbinary gender, and to persons from Europe/North America over Africa/Asia, pointing towards Stable Diffusion having a concerning representation of personhood to be a European/North American man. We also show continental stereotypes and resultant harms e.g. a person from Oceania is deemed to be Australian/New Zealander over Papua New Guinean, pointing to the erasure of Indigenous Oceanic peoples, who form a majority over descendants of colonizers both in Papua New Guinea and in Oceania overall. Finally, we unexpectedly observe a pattern of oversexualization of women, specifically Latin American, Mexican, Indian and Egyptian women relative to other nationalities, measured through an NSFW detector. This demonstrates how Stable Diffusion perpetuates Western fetishization of women of color through objectification in media, which if left unchecked will amplify this stereotypical representation. Image datasets are made publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑