Does Data-Efficient Generalization Exacerbate Bias in Foundation Models?
Universidade Federal de São Paulo(圣保罗联邦大学);Instituto Federal de Goiás(戈亚斯联邦学院);Idiap Research Institute(伊迪亚普研究所)
Dilermando Queiroz, Anderson Carlos, Maíra Fatoretto, Luis Filipe Nakayama, André Anjos, Lilian Berton
备注:
Preprint of paper to be presented at Fairness and Ethics Towards Transparent AI: Facing the Challenge through Model Debiasing (FAILED) during ECCV 2024
Foundation models have emerged as robust models with label efficiency in diverse domains. In medical imaging, these models contribute to the advancement of medical diagnoses due to the difficulty in obtaining labeled data. However, it is unclear whether using a large amount of unlabeled data, biased by the presence of sensitive attributes during pre-training, influences the fairness of the model. This research examines the bias in the Foundation model (RetFound) when it is applied to fine-tune the Brazilian Multilabel Ophthalmological Dataset (BRSET), which has a different population than the pre-training dataset. The model evaluation, in comparison with supervised learning, shows that the Foundation Model has the potential to reduce the gap between the maximum AUC and minimum AUC evaluations across gender and age groups. However, in a data-efficient generalization, the model increases the bias when the data amount decreases. These findings suggest that when deploying a Foundation Model in real-life scenarios with limited data, the possibility of fairness issues should be considered.
Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging
Massachusetts Institute of Technology(麻省理工学院);University of California, San Diego(加州大学圣地亚哥分校);University of Washington(华盛顿大学);University of Washington School of Medicine(华盛顿大学医学院)
From Bias to Balance: Detecting Facial Expression Recognition Biases in Large Multimodal Foundation Models
Lake Wales High School(莱克威尔士高中);Thomas Jefferson Sr. High School(托马斯·杰斐逊高中);Bellarmine College Preparatory(贝拉明学院预科学校);Algoverse AI Research(Algoverse AI研究机构)
Rethinking the Bias of Foundation Model under Long-tailed Distribution
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学耿丽人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(北京大数据管理与分析方法重点实验室);Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程学院);University of Chinese Academy of Sciences(中国科学院大学)
Bias and Generalizability of Foundation Models across Datasets in Breast Mammography
University Hospital Bonn(波恩大学医院);Technical University of Munich(慕尼黑技术大学);Lebanese Hospital Geitaoui(黎巴嫩Geitaoui医院);Helmholtz AI, Helmholtz Munich(海德堡人工智能,海德堡慕尼黑)
ULFine: Unbiased Lightweight Fine-tuning for Foundation-Model-Assisted Long-Tailed Semi-Supervised Learning
MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, China(信息产业部模式分析与机器智能重点实验室,中国);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院)
Reading Smiles: Proxy Bias in Foundation Models for Facial Emotion Recognition
CHI – Chair of Health Informatics, MRI, Technical University of Munich(慕尼黑技术大学健康信息学系);MCML – Munich Center for Machine Learning(慕尼黑机器学习中心);GLAM – Group on Language, Audio, & Music(语言、音频与音乐小组);MDSI – Munich Data Science Institute(慕尼黑数据科学研究所)
Confidence Scores in Open-Vocabulary Detection Are a Biased Mixture of Scale and Semantics
Institute of Intelligence Systems, National Yang Ming Chiao Tung University(国立阳明交通大学智能系统研究所);College of Artificial Intelligence and Green Energy, National Yang Ming Chiao Tung University(国立阳明交通大学人工智能与绿色能源学院)