arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.00524cs.LGcs.CV
收藏

有限数据下的深度模型解释:一种基于核心集(Coreset)的方法

Deep Model Interpretation with Limited Data : A Coreset-based Approach

University of Antwerp(安特卫普大学);imec

Hamed Behzadi-Khormouji, José Oramas

AI总结:

针对现有模型解释方法计算成本高、小数据集易导致洞见不足的问题,提出基于核心集的解释框架及相似性评估协议,实验验证了其有效性。

摘要:

模型解释旨在从已训练模型的内部提取洞见。解决该任务的常用方法是表征模型内部编码的、对其正常运行至关重要的相关特征。尽管这类方法近期取得了进展,但它们存在计算成本高昂的缺陷,因为需要对数据集进行密集评估。因此,这类方法的设计研究多聚焦于更小的数据子集,这可能导致提取的洞见减少。为解决这些计算成本问题,我们提出一种基于核心集(coreset)的解释框架,利用核心集选择方法从大型数据集中采样出具有代表性的子集用于解释任务。为此,我们提出一种基于相似性的评估协议,用于衡量模型解释方法对其输入数据量的鲁棒性。在多种解释方法、DNN模型和核心集选择方法上开展的实验,验证了所提框架的有效性。

英文摘要:

Model Interpretation aims at the extraction of insights from the internals of a trained model. A common approach to address this task is the characterization of relevant features internally encoded in the model that are critical for its proper operation. Despite recent progress of these methods, they come with the weakness of being computationally expensive due to the dense evaluation of datasets that they require. As a consequence, research on the design of these methods have focused on smaller data subsets which may led to reduced insights. To address these computational costs, we propose a coreset-based interpretation framework that utilizes coreset selection methods to sample a representative subset of the large dataset for the interpretation task. Towards this goal, we propose a similarity-based evaluation protocol to assess the robustness of model interpretation methods towards the amount data they take as input. Experiments considering several interpretation methods, DNN models, and coreset selection methods show the effectiveness of the proposed framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑