arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.19949cs.CV
收藏

FairCLIP:在视觉-语言学习中利用公平性

FairCLIP: Harnessing Fairness in Vision-Language Learning

Harvard University(哈佛大学);New York University(纽约大学);New York University Abu Dhabi(纽约大学阿布扎比分校)

Yan Luo, Min Shi, Muhammad Osama Khan, Muhammad Muneeb Afzal, Hao Huang, Shuaihang Yuan, Yu Tian, Luo Song, Ava Kouhana, Tobias Elze, Yi Fang, Mengyu Wang

AI总结:

针对医学视觉-语言模型公平性研究缺乏数据集的问题,本文构建Harvard-FairVLMed并分析CLIP、BLIP2的偏见,提出基于最优传输的FairCLIP以平衡性能与公平性。

摘要:

公平性是深度学习中的一个关键问题,尤其是在医疗领域,这些模型会影响诊断和治疗决策。尽管公平性已在纯视觉领域得到研究,但由于缺乏用于研究公平性的医学视觉-语言(VL)数据集,医学VL模型的公平性仍未被探索。为弥合这一研究空白,我们推出了首个公平视觉-语言医学数据集Harvard-FairVLMed,该数据集提供详细的人口统计属性、真实标签和临床记录,以促进对VL基础模型内部公平性的深入考察。利用Harvard-FairVLMed,我们对两种广泛使用的VL模型(CLIP和BLIP2)进行了全面的公平性分析,这些模型在自然和医学领域均经过预训练,分析涵盖四个不同的受保护属性。我们的结果凸显了所有VL模型中存在的显著偏见:在种族、性别、族裔和语言这些受保护属性上,亚洲人、男性、非西班牙裔和西班牙语使用者分别成为受偏好的子群体。为缓解这些偏见,我们提出了FairCLIP,这是一种基于最优传输的方法,通过缩小总体样本分布与各人口统计群体对应分布之间的Sinkhorn距离,在性能与公平性之间实现良好的权衡。作为首个此类VL数据集,Harvard-FairVLMed有潜力推动兼具伦理意识和临床有效性的机器学习模型的发展。我们的数据集和代码可在https://ophai.hms.harvard.edu/datasets/harvard-fairvlmed10k获取。

英文摘要:

Fairness is a critical concern in deep learning, especially in healthcare, where these models influence diagnoses and treatment decisions. Although fairness has been investigated in the vision-only domain, the fairness of medical vision-language (VL) models remains unexplored due to the scarcity of medical VL datasets for studying fairness. To bridge this research gap, we introduce the first fair vision-language medical dataset Harvard-FairVLMed that provides detailed demographic attributes, ground-truth labels, and clinical notes to facilitate an in-depth examination of fairness within VL foundation models. Using Harvard-FairVLMed, we conduct a comprehensive fairness analysis of two widely-used VL models (CLIP and BLIP2), pre-trained on both natural and medical domains, across four different protected attributes. Our results highlight significant biases in all VL models, with Asian, Male, Non-Hispanic, and Spanish being the preferred subgroups across the protected attributes of race, gender, ethnicity, and language, respectively. In order to alleviate these biases, we propose FairCLIP, an optimal-transport-based approach that achieves a favorable trade-off between performance and fairness by reducing the Sinkhorn distance between the overall sample distribution and the distributions corresponding to each demographic group. As the first VL dataset of its kind, Harvard-FairVLMed holds the potential to catalyze advancements in the development of machine learning models that are both ethically aware and clinically effective. Our dataset and code are available at https://ophai.hms.harvard.edu/datasets/harvard-fairvlmed10k.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑