Fraunhofer IPA(弗劳恩霍夫生产技术与自动化研究所);CNR Institute of Applied Sciences and Intelligent Systems(意大利国家研究委员会应用科学与智能系统研究所);IDS Imaging Development Systems GmbH(IDS成像开发系统有限公司);University of Stuttgart(斯图加特大学)
Nina Schaaf, Omar de Mitri, Hang Beom Kim, Alexander Windberger, Marco F. Huber
备注:
Accepted for publication at the 30th International Conference on Artificial Neural Networks (ICANN)
Convolutional Neural Networks (CNN) have become de fact state-of-the-art for the main computer vision tasks. However, due to the complex underlying structure their decisions are hard to understand which limits their use in some context of the industrial world. A common and hard to detect challenge in machine learning (ML) tasks is data bias. In this work, we present a systematic approach to uncover data bias by means of attribution maps. For this purpose, first an artificial dataset with a known bias is created and used to train intentionally biased CNNs. The networks' decisions are then inspected using attribution maps. Finally, meaningful metrics are used to measure the attribution maps' representativeness with respect to the known bias. The proposed study shows that some attribution map techniques highlight the presence of bias in the data better than others and metrics can support the identification of bias.
LIBRA: Measuring Bias of Large Language Model from a Local Context
School of Computer Science, University of Auckland(奥克兰大学计算机科学学院);The Liggins Institute, University of Auckland(奥克兰大学利金斯研究所);Research Centre for Māori Health and Development, Massey University(梅西大学毛利人健康与发展研究中心)
Ask Me Again Differently: GRAS for Measuring Bias in Vision Language Models on Gender, Race, Age, and Skin Tone
Guru Gobind Singh Indraprastha University(古鲁·戈宾德·辛格印度教普拉斯塔大学);AI Institute, University of South Carolina(南卡罗来纳大学人工智能研究所);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Indian Institute of Technology Patna, India(印度理工学院帕纳布分校)
VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Models
University of Southern California(南加州大学);University of Bristol(布里斯托大学);Centre National de la Recherche Scientifique(法国国家科学研究中心);University of California, Los Angeles(加州大学洛杉矶分校)
Measuring Social Bias in Vision-Language Models with Face-Only Counterfactuals from Real Photos
School of Intelligence Science and Engineering, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)智能科学与工程学院);School of Information Science and Engineering, Ningbo University(宁波大学信息科学与工程学院);School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学与技术学院)
Measuring the Biases and Effectiveness of Content-Style Disentanglement
University of Edinburgh(爱丁堡大学);IMT School for Advanced Studies Lucca(卢卡高等研究院);Canon Medical Research Europe Ltd.(佳能医疗欧洲研究有限公司);The Alan Turing Institute(艾伦·图灵研究所)
What Are We Really Measuring? Rethinking Dataset Bias in Web-Scale Natural Image Collections via Unsupervised Semantic Clustering
School of Electrical Engineering, Iran University of Science and Technology (IUST)(伊朗科学技术大学电气工程学院);Okinawa Institute of Science and Technology (OIST)(冲绳科学技术大学院大学)