arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.06129cs.LGcs.CV
收藏

无标签概念瓶颈模型

Label-Free Concept Bottleneck Models

UCSD(加州大学圣地亚哥分校);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);IBM Research(IBM研究院)

Tuomas Oikarinen, Subhro Das, Lam M. Nguyen, Tsui-Wei Weng

AI总结:

针对概念瓶颈模型依赖概念标签且准确率较低的问题,本文提出 Label-free CBM,无需概念标签即可将神经网络转为高准确率、可扩展且自动化的可解释 CBM。

摘要:

概念瓶颈模型(CBM)是一种通过让隐藏层神经元对应人类可理解概念来构建更具可解释性神经网络的常用方法。然而,现有 CBM 及其变体存在两个关键局限:第一,它们需要为每个预定义概念收集带标签数据,这既耗时又耗费人力;第二,CBM 的准确率通常显著低于标准神经网络,尤其是在更复杂的数据集上。这种较差的性能为 CBM 在实际现实应用中的采用造成了障碍。受这些挑战启发,我们提出了 Label-free CBM,这是一种新颖框架,可在没有带标签概念数据的情况下将任意神经网络转换为可解释的 CBM,同时保持较高准确率。我们的 Label-free CBM 具有多项优势:可扩展——我们提出了首个扩展到 ImageNet 的 CBM;高效——即使对于非常大的数据集,创建 CBM 也只需几个小时;自动化——针对新数据集训练它所需的人工投入极少。我们的代码可在 https://github.com/Trustworthy-ML-Lab/Label-free-CBM 获取。最后,我们在附录 B 中对该方法的可解释性进行了大规模用户评估。

英文摘要:

Concept bottleneck models (CBM) are a popular way of creating more interpretable neural networks by having hidden layer neurons correspond to human-understandable concepts. However, existing CBMs and their variants have two crucial limitations: first, they need to collect labeled data for each of the predefined concepts, which is time consuming and labor intensive; second, the accuracy of a CBM is often significantly lower than that of a standard neural network, especially on more complex datasets. This poor performance creates a barrier for adopting CBMs in practical real world applications. Motivated by these challenges, we propose Label-free CBM which is a novel framework to transform any neural network into an interpretable CBM without labeled concept data, while retaining a high accuracy. Our Label-free CBM has many advantages, it is: scalable - we present the first CBM scaled to ImageNet, efficient - creating a CBM takes only a few hours even for very large datasets, and automated - training it for a new dataset requires minimal human effort. Our code is available at https://github.com/Trustworthy-ML-Lab/Label-free-CBM. Finally, in Appendix B we conduct a large scale user evaluation of the interpretability of our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑