Current face recognition systems achieve high progress on several benchmark tests. Despite this progress, recent works showed that these systems are strongly biased against demographic sub-groups. Consequently, an easily integrable solution is needed to reduce the discriminatory effect of these biased systems. Previous work mainly focused on learning less biased face representations, which comes at the cost of a strongly degraded overall recognition performance. In this work, we propose a novel unsupervised fair score normalization approach that is specifically designed to reduce the effect of bias in face recognition and subsequently lead to a significant overall performance boost. Our hypothesis is built on the notation of individual fairness by designing a normalization approach that leads to treating similar individuals similarly. Experiments were conducted on three publicly available datasets captured under controlled and in-the-wild circumstances. Results demonstrate that our solution reduces demographic biases, e.g. by up to 82.7% in the case when gender is considered. Moreover, it mitigates the bias more consistently than existing works. In contrast to previous works, our fair normalization approach enhances the overall performance by up to 53.2% at false match rate of 0.001 and up to 82.9% at a false match rate of 0.00001. Additionally, it is easily integrable into existing recognition systems and not limited to face biometrics.
Microsoft AI R&D Center, Taiwan（台湾微软人工智能研发中心）；National Tsing Hua University（国立清华大学）
Although significant progress has been made in face recognition, demographic bias still exists in face recognition systems. For instance, it usually happens that the face recognition performance for a certain demographic group is lower than the others. In this paper, we propose MixFairFace framework to improve the fairness in face recognition models. First of all, we argue that the commonly used attribute-based fairness metric is not appropriate for face recognition. A face recognition system can only be considered fair while every person has a close performance. Hence, we propose a new evalua…
Face biometrics are playing a key role in making modern smart city applications more secure and usable. Commonly, the recognition threshold of a face recognition system is adjusted based on the degree of security for the considered use case. The likelihood of a match can be for instance decreased by setting a high threshold in case of a payment transaction verification. Prior work in face recognition has unfortunately showed that error rates are usually higher for certain demographic groups. These disparities have hence brought into question the fairness of systems empowered with face biometri…
Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity recognition or image captioning. Various mitigation techniques have been presented to prevent models from utilizing or learning such biases. However, there has been little systematic comparison between these techniques. We design a simple but surprisingly effective visual recognition benchmark for studying bias mitigation. Using this benchmark, we provide a tho…
On the Illusion of Gender Bias in Face Recognition: Explaining the Fairness Issue Through Non-demographic Attributes
Paderborn University（帕德博恩大学）；Technical University of Darmstadt（达姆施塔特技术大学）；University of Notre Dame（诺特丹大学）；Johannes Gutenberg University Mainz（美因茨约翰· Gutenberg大学）
A major problem with using automated classification systems is that if they are not engineered correctly and with fairness considerations, they could be detrimental to certain populations. Furthermore, while engineers have developed cutting-edge technologies for image classification, there is still a gap in the application of these models in human heritage collections, where data sets usually consist of low-quality pictures of people with diverse ethnicity, gender, and age. In this work, we evaluate three bias mitigation techniques using two state-of-the-art neural networks, Xception and Effic…
Recently, different researchers have found that the gallery composition of a face database can induce performance differentials to facial identification systems in which a probe image is compared against up to all stored reference images to reach a biometric decision. This negative effect is referred to as "watchlist imbalance effect". In this work, we present a method to theoretically estimate said effect for a biometric identification system given its verification performance across demographic groups and the composition of the used gallery. Further, we report results for identification expe…
University of Wisconsin–Madison（威斯康星大学麦迪逊分校）；University of Michigan（密歇根大学）
The proliferation of automated face recognition in the commercial and government sectors has caused significant privacy concerns for individuals. One approach to address these privacy concerns is to employ evasion attacks against the metric embedding networks powering face recognition systems: Face obfuscation systems generate imperceptibly perturbed images that cause face recognition systems to misidentify the user. Perturbed faces are generated on metric embedding networks, which are known to be unfair in the context of face recognition. A question of demographic fairness naturally follows: …
FairForensics: Seeing Expressions and Parsing Demographics via Vision-Language Modeling for Generalizable Fair Deepfake Detection
Shenzhen University（深圳大学）；Shandong Artificial Intelligence Institute（山东省人工智能研究院）；Qilu University of Technology (Shandong Academy of Sciences)（齐鲁工业大学（山东省科学院））；Tianjin University of Technology（天津理工大学）
Mitigating Group-Level Fairness Disparities in Federated Visual Language Models
Great Bay University（大湾大学）；Tsinghua Shenzhen International Graduate School（清华大学深圳国际研究生院）；Nanyang Technological University（南洋理工大学）；Beijing University of Posts and Telecommunications（北京邮电大学）；Shenzhen University（深圳大学）；Pengcheng Laboratory（鹏城实验室）；Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区）
Auditing Demographic Bias in Facial Landmark Detection for Fair Human-Robot Interaction
Departamento de Inteligencia Artificial, Universidad Politécnica de Madrid（智能人工智能部门，马德里理工大学）；Departamento de Informática y Estadística, Universidad Rey Juan Carlos（信息与统计学部门，皇家胡安·卡洛斯大学）；ELLIS Unit Madrid（马德里ELLIS单位）
Can Vision Transformers with ResNet's Global Features Fairly Authenticate Demographic Faces?
National Research Council of Italy - Institute of Applied Sciences and Intelligent Systems (CNR-ISASI)（意大利国家研究 council - 应用科学和智能系统研究所（CNR-ISASI））；University of Gour Banga（Gour Banga 大学）；Visva-Bharati（Visva-Bharati 研究院）
Redundant Semantic Environment Filling via Misleading-Learning for Fair Deepfake Detection
School of Software, Nanchang University（南昌大学软件学院）；Guangdong Key Laboratory of Intelligent Information Processing and Shenzhen Key Laboratory of Media Security, Shenzhen University（广东省智能信息处理重点实验室和深圳媒体安全重点实验室，深圳大学）；Department of Computer and Information Technology, Purdue University（计算机与信息科技系，普渡大学）；Guangdong Laboratory of Machine Perception and Intelligent Computing, Faculty of Engineering, Shenzhen MSU-BIT University（广东机器感知与智能计算实验室，工程学院，深圳MSU-BIT大学）
Decoupling Bias, Aligning Distributions: Synergistic Fairness Optimization for Deepfake Detection
Nanchang University（南昌大学）；Guangdong Provincial Key Laboratory of Intelligent Information Processing（广东省智能信息处理重点实验室）；Shenzhen Key Laboratory of Media Security（深圳媒体安全重点实验室）；SZU–AFS Joint Innovation Center for AI Technology（深圳大学-AFS人工智能技术联合创新中心）；Shenzhen University（深圳大学）；Purdue University（普渡大学）
There has been increasing awareness of ethical issues in machine learning, and fairness has become an important research topic. Most fairness efforts in computer vision have been focused on human sensing applications and preventing discrimination by people's physical attributes such as race, skin color or age by increasing visual representation for particular demographic groups. We argue that ML fairness efforts should extend to object recognition as well. Buildings, artwork, food and clothing are examples of the objects that define human culture. Representing these objects fairly in machine l…
FAIRT2V: Training-Free Debiasing for Text-to-Video Diffusion Models
School of Computer Science and Engineering, University of New South Wales, Australia.（新南威尔士大学计算机科学与工程学院，澳大利亚）；State Key Laboratory for Novel Software Technology, Nanjing University, China（南京大学新型软件技术国家重点实验室，中国）
CompDiff enables fair and zero shot medical image generation across demographic intersections through compositional diffusion
Institute of Data Science, Faculty of Science and Engineering, Maastricht University, Maastricht, The Netherlands（数据科学研究所，科学与工程学院，马斯特里赫特大学，马斯特里赫特，荷兰）；Department of Advanced Computing Sciences, Faculty of Science and Engineering, Maastricht University, Maastricht, The Netherlands（先进计算科学系，科学与工程学院，马斯特里赫特大学，马斯特里赫特，荷兰）；VITO, Belgium（比利时VITO研究院）
Operationalizing Fairness in Text-to-Image Models: A Survey of Bias, Fairness Audits and Mitigation Strategies
AImotion Bavaria, Technische Hochschule Ingolstadt（AImotion巴伐利亚、因戈尔施塔特技术大学）；School of Transformation and Sustainability, Catholic University of Eichstätt-Ingolstadt（转型与可持续性学院，埃施塔特-因戈尔施塔特天主教大学）；Chair of Economic and Social Ethics, University of Hohenheim（经济与社会伦理系，霍亨海姆大学）
