arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.03386cs.CVcs.LG
收藏

一种用于图像数据归因的简单高效基线方法

A Simple and Efficient Baseline for Data Attribution on Images

University of Maryland(马里兰大学);New York University(纽约大学);ELLIS Institute Tübingen(蒂宾根ELLIS研究所);MPI for Intelligent Systems(马克斯·普朗克智能系统研究所);Tübingen AI Center(蒂宾根人工智能中心)

Vasu Singla, Pedro Sandoval-Segura, Micah Goldblum, Jonas Geiping, Tom Goldstein

AI总结:

针对现有图像数据归因方法计算内存成本高、难扩展的问题,提出基于自监督预训练骨干特征空间的极简基线方法,模型无关易扩展,在CIFAR-10、ImageNet上性能媲美或超越SOTA且成本极低。

摘要:

数据归因方法在理解机器学习模型方面发挥着关键作用,能够揭示部署阶段哪些训练数据点对模型输出的影响最大。然而,当前最先进的方法需要多达30万个模型的大型集成,才能准确归因模型预测结果。因此这些方法计算成本高、内存占用大,难以扩展到大型模型或数据集。在本研究中,我们聚焦于一种极简基线方法,利用通过自监督学习预训练的骨干网络的特征空间执行数据归因。我们的方法具有模型无关性,可轻松扩展到大型数据集。我们在CIFAR-10和ImageNet上展示了实验结果,该方法取得了优异性能,可匹敌甚至超越最先进方法,而计算和内存成本仅为其一小部分。与先前研究相反,我们的结果强化了这一直觉:模型对单张图像的预测受视觉相似的训练样本影响最大。我们的方法可作为图像数据归因领域的一种简单高效的基线。

英文摘要:

Data attribution methods play a crucial role in understanding machine learning models, providing insight into which training data points are most responsible for model outputs during deployment. However, current state-of-the-art approaches require a large ensemble of as many as 300,000 models to accurately attribute model predictions. These approaches therefore come at a high computational cost, are memory intensive, and are hard to scale to large models or datasets. In this work, we focus on a minimalist baseline, utilizing the feature space of a backbone pretrained via self-supervised learning to perform data attribution. Our method is model-agnostic and scales easily to large datasets. We show results on CIFAR-10 and ImageNet, achieving strong performance that rivals or outperforms state-of-the-art approaches at a fraction of the compute or memory cost. Contrary to prior work, our results reinforce the intuition that a model's prediction on one image is most impacted by visually similar training samples. Our approach serves as a simple and efficient baseline for data attribution on images.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑