The recent advancement of large and powerful models with Text-to-Image (T2I) generation abilities -- such as OpenAI's DALLE-3 and Google's Gemini -- enables users to generate high-quality images from textual prompts. However, it has become increasingly evident that even simple prompts could cause T2I models to exhibit conspicuous social bias in generated images. Such bias might lead to both allocational and representational harms in society, further marginalizing minority groups. Noting this problem, a large body of recent works has been dedicated to investigating different dimensions of bias in T2I systems. However, an extensive review of these studies is lacking, hindering a systematic understanding of current progress and research gaps. We present the first extensive survey on bias in T2I generative models. In this survey, we review prior studies on dimensions of bias: Gender, Skintone, and Geo-Culture. Specifically, we discuss how these works define, evaluate, and mitigate different aspects of bias. We found that: (1) while gender and skintone biases are widely studied, geo-cultural bias remains under-explored; (2) most works on gender and skintone bias investigated occupational association, while other aspects are less frequently studied; (3) almost all gender bias works overlook non-binary identities in their studies; (4) evaluation datasets and metrics are scattered, with no unified framework for measuring biases; and (5) current mitigation methods fail to resolve biases comprehensively. Based on current limitations, we point out future research directions that contribute to human-centric definitions, evaluations, and mitigation of biases. We hope to highlight the importance of studying biases in T2I systems, as well as encourage future efforts to holistically understand and tackle biases, building fair and trustworthy T2I technologies for everyone.
BiasMap: Leveraging Cross-Attentions to Discover and Mitigate Hidden Social Biases in Text-to-Image Generation
Institute for Clarity in Documentation(清晰文档研究所);Inria Paris-Rocquencourt(巴黎-罗克琴court研究所);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室);University of North Carolina at Charlotte(北卡罗来纳大学教堂山分校);Utah State University(犹他州立大学)
Operationalizing Fairness in Text-to-Image Models: A Survey of Bias, Fairness Audits and Mitigation Strategies
AImotion Bavaria, Technische Hochschule Ingolstadt(AImotion巴伐利亚、因戈尔施塔特技术大学);School of Transformation and Sustainability, Catholic University of Eichstätt-Ingolstadt(转型与可持续性学院,埃施塔特-因戈尔施塔特天主教大学);Chair of Economic and Social Ethics, University of Hohenheim(经济与社会伦理系,霍亨海姆大学)
Understanding-informed Bias Mitigation for Fair CMR Segmentation
College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);Guy’s and St Thomas’ NHS Foundation Trust(盖茨和圣托马斯国家健康服务基金会信托);HeartFlow Inc, United States(美国HeartFlow公司);British Heart Foundation Centre, Department of Clinical Pharmacology, King’s College London(英国心脏基金会中心、伦敦国王学院临床药理学系);School of Biomedical Engineering & Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与成像科学学院)
Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Data
Fraunhofer Heinrich Hertz Institut(弗劳恩霍夫 Heinrich Hertz 研究所);Technische Universität Berlin(柏林技术大学);Berlin Institute for the Foundations of Learning and Data (BIFOLD)(柏林学习与数据基础研究所(BIFOLD))
BiMa: Towards Biases Mitigation for Text-Video Retrieval via Scene Element Guidance
FPT Software AI Center(FPT软件AI中心);Aalborg University(奥尔堡大学);Pioneer Centre for AI(先锋人工智能中心);University of Liverpool(利物浦大学);AICV Lab, University of Arkansas(AICV实验室,阿肯色大学)
BM-CL: Bias Mitigation through the lens of Continual Learning
Research Institute for Signals, Systems and Computational Intelligence, sinc(i), CONICET - Universidad Nacional del Litoral(信号、系统与计算智能研究所以及CONICET - 国家沿海大学);AI Development and Evaluation (AIDE) Lab, Stanford University(人工智能发展与评估实验室,斯坦福大学);Institute of Computer Sciences (ICC), CONICET - Universidad de Buenos Aires(计算机科学研究所(ICC),CONICET - 阿根廷布宜诺斯艾利斯大学)