As deep learning models become tasked with more and more decisions that impact human lives, such as criminal recidivism, loan repayment, and face recognition for law enforcement, bias is becoming a growing concern. Debiasing algorithms are typically split into three paradigms: pre-processing, in-processing, and post-processing. However, in computer vision or natural language applications, it is common to start with a large generic model and then fine-tune to a specific use-case. Pre- or in-processing methods would require retraining the entire model from scratch, while post-processing methods only have black-box access to the model, so they do not leverage the weights of the trained model. Creating debiasing algorithms specifically for this fine-tuning use-case has largely been neglected.
In this work, we initiate the study of a new paradigm in debiasing research, intra-processing, which sits between in-processing and post-processing methods. Intra-processing methods are designed specifically to debias large models which have been trained on a generic dataset and fine-tuned on a more specific task. We show how to repurpose existing in-processing methods for this use-case, and we also propose three baseline algorithms: random perturbation, layerwise optimization, and adversarial fine-tuning. All of our techniques can be used for all popular group fairness measures such as equalized odds or statistical parity difference. We evaluate these methods across three popular datasets from the AIF360 toolkit, as well as on the CelebA faces dataset. Our code is available at https://github.com/abacusai/intraprocessing_debiasing.
Transparency and Proportionality in Post-Processing Algorithmic Bias Correction
Data Science and Computational Intelligence Institute (DaSCI), University of Granada(数据科学与计算智能研究所(DaSCI)、格拉纳达大学);Department of Information Science and Media Studies, University of Bergen(信息科学与媒体研究系、卑尔根大学);Data Science and Computational Intelligence Institute (DaSCI), Department of Computer Science and Artificial Intelligence (DCSAI), University of Granada(数据科学与计算智能研究所(DaSCI)、计算机科学与人工智能系(DCSAI)、格拉纳达大学)
Debiased Distillation by Transplanting the Last Layer
Department of Electrical Engineering, POSTECH(POSTECH电气工程系);Graduate School of Artificial Intelligence, POSTECH(POSTECH人工智能研究生院);POSTECH(POSTECH(浦项科技大学))
深度模型很容易学习虚假的相关性,即使在后处理过程中也是如此。我们仔细研究了知识蒸馏--一种流行的模型压缩后处理技术--并发现,使用有偏见的训练数据进行蒸馏会产生有偏见的学生,即使教师是无偏见的。为了解决这个问题,我们提出了一个简单的知识蒸馏算法,创造DeTT(Debiasing by Teacher Transplanting)。最近的一项观察发现,最后一层神经网络在去偏置中起着极其重要的作用,受此启发,DeTT将教师的最后一层直接移植到学生身上。通过匹配学生和教师的特征图输出来提取剩余的层,其中样本被重新加权以减轻数据集偏差。重要的是,DeTT不依赖于偏差相关属性上的广泛注释的可用性,这通常在后处理阶段不可用。在我们的整个实验中,DeTT成功地消除了学生模型的偏差,在最差组准确性方面始终优于基线。
InTrain: Intrinsic Trainability for Zero-Cost Neural Architecture Search
School of Computer and Data Science, Fuzhou University(福州大学计算机与数据科学学院);School of Computer and Data Science, Minjiang University(闽江学院计算机与数据科学学院);School of Artificial Intelligence, Nanchang University(南昌大学人工智能学院);Department of Computer Science, Hong Kong Baptist University(香港浸会大学计算机科学系);School of Interdisciplinary Medicine and Engineering, Harbin Medical University(哈尔滨医科大学跨学科医学与工程学院)