Training datasets are crucial for convolutional neural network-based algorithms, which directly impact their overall performance. As such, using a well-structured dataset that has minimum level of bias is always desirable. In this paper, we proposed a novel, domain-independent approach, called score-based resampling (SBR), to locate the under-represented samples of the original training dataset based on the model prediction scores obtained with that training set. In our method, once trained, we use the same CNN model to infer on its own training samples, obtain prediction scores, and based on the distance between predicted and ground-truth, we identify samples that are far away from their ground-truth and augment them in the original training set. The temperature term of the Sigmoid function is decreased to better differentiate scores. For experimental evaluation, we selected one Kaggle dataset for gender classification. We first used a CNN-based classifier with relatively standard structure, trained on the training images, and evaluated on the provided validation samples of the original dataset. Then, we assessed it on a totally new test dataset consisting of light male, light female, dark male, and dark female groups. The obtained accuracies varied, revealing the existence of categorical bias against certain groups in the original dataset. Subsequently, we trained the model after resampling based on our proposed approach. We compared our method with a previously proposed variational autoencoder (VAE) based algorithm. The obtained results confirmed the validity of our proposed method regrading identifying under-represented samples among original dataset to decrease categorical bias of classifying certain groups. Although tested for gender classification, the proposed algorithm can be used for investigating dataset structure of any CNN-based tasks.
BM-CL: Bias Mitigation through the lens of Continual Learning
Research Institute for Signals, Systems and Computational Intelligence, sinc(i), CONICET - Universidad Nacional del Litoral(信号、系统与计算智能研究所以及CONICET - 国家沿海大学);AI Development and Evaluation (AIDE) Lab, Stanford University(人工智能发展与评估实验室,斯坦福大学);Institute of Computer Sciences (ICC), CONICET - Universidad de Buenos Aires(计算机科学研究所(ICC),CONICET - 阿根廷布宜诺斯艾利斯大学)
Understanding-informed Bias Mitigation for Fair CMR Segmentation
College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);Guy’s and St Thomas’ NHS Foundation Trust(盖茨和圣托马斯国家健康服务基金会信托);HeartFlow Inc, United States(美国HeartFlow公司);British Heart Foundation Centre, Department of Clinical Pharmacology, King’s College London(英国心脏基金会中心、伦敦国王学院临床药理学系);School of Biomedical Engineering & Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与成像科学学院)
Ensuring Medical AI Safety: Interpretability-Driven Detection and Mitigation of Spurious Model Behavior and Associated Data
Fraunhofer Heinrich Hertz Institut(弗劳恩霍夫 Heinrich Hertz 研究所);Technische Universität Berlin(柏林技术大学);Berlin Institute for the Foundations of Learning and Data (BIFOLD)(柏林学习与数据基础研究所(BIFOLD))
BiasMap: Leveraging Cross-Attentions to Discover and Mitigate Hidden Social Biases in Text-to-Image Generation
Institute for Clarity in Documentation(清晰文档研究所);Inria Paris-Rocquencourt(巴黎-罗克琴court研究所);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室);University of North Carolina at Charlotte(北卡罗来纳大学教堂山分校);Utah State University(犹他州立大学)