arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.01166cs.CV
收藏

可解释的神经网络解耦

Interpretable Neural Network Decoupling

Xiamen University(厦门大学);Peng Cheng Laboratory(鹏城实验室);National University of Singapore(新加坡国立大学);Beihang University(北京航空航天大学);BestImage, Tencent Technology (Shanghai) Co.,Ltd(腾讯科技(上海)有限公司);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Inception Institute of Artificial Intelligence(起源人工智能研究院)

Yuchao Li, Rongrong Ji, Shaohui Lin, Baochang Zhang, Chenqian Yan, Yongjian Wu, Feiyue Huang, Ling Shao

摘要:

卷积神经网络(CNN)的卓越性能与其大量不可解释的参数纠缠在一起,这已成为限制其充分发挥潜力的瓶颈。对于网络的解释,以往的研究主要采用单一的过滤器分析,但忽略了过滤器之间的关系。在本文中,我们提出了一种新的架构解耦方法来解释网络的角度调查其计算路径。更具体地说,我们在每一层中引入了一个新的架构控制模块,通过一个向量对网络架构进行编码。通过最大化矢量和输入图像之间的互信息,该模块被训练为选择特定的滤波器来提取每个输入的唯一计算路径。此外,为了提高解耦合网络的可解释性和紧凑性,对每一层的输出进行编码,以将结构编码向量与稀疏正则化约束对齐。与传统的像素级或过滤器级网络解释方法不同,我们提出了一种路径级分析,以探索过滤器和语义概念的组合之间的关系,这更适合于解释解耦网络的工作原理。大量的实验表明,解耦网络实现了几个应用,即,网络解释、网络加速和对抗性样本检测。

英文摘要:

The remarkable performance of convolutional neural networks (CNNs) is entangled with their huge number of uninterpretable parameters, which has become the bottleneck limiting the exploitation of their full potential. Towards network interpretation, previous endeavors mainly resort to the single filter analysis, which however ignores the relationship between filters. In this paper, we propose a novel architecture decoupling method to interpret the network from a perspective of investigating its calculation paths. More specifically, we introduce a novel architecture controlling module in each layer to encode the network architecture by a vector. By maximizing the mutual information between the vectors and input images, the module is trained to select specific filters to distill a unique calculation path for each input. Furthermore, to improve the interpretability and compactness of the decoupled network, the output of each layer is encoded to align the architecture encoding vector with the constraint of sparsity regularization. Unlike conventional pixel-level or filter-level network interpretation methods, we propose a path-level analysis to explore the relationship between the combination of filter and semantic concepts, which is more suitable to interpret the working rationale of the decoupled network. Extensive experiments show that the decoupled network achieves several applications, i.e., network interpretation, network acceleration, and adversarial samples detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑