理解分层神经网络中的社团结构
Understanding Community Structure in Layered Neural Networks
摘要:
分层神经网络现在是预测高维实际数据集的最常见的选择之一,其中输入和输出数据之间的关系是复杂的,并且不能用简单的常规模型很好地表示。它的有效性在各种任务中得到了证明,然而,分层神经网络训练结果缺乏可解释性,限制了它的应用范围。在我们以前的研究中,我们提出了一种方法来提取一个简化的全局结构的训练分层神经网络的分类到社区的单位根据其连接模式与相邻层。这些方法为我们提供了知识的强度的社区之间的关系,从存在的捆绑连接,这是由阈值处理的社区对之间的连接比率。然而,很难通过观察模块结构来定量地了解每个社区的作用。我们只能通过追踪从社区到输入层和输出层的捆绑连接来知道每个社区主要连接到哪些输入和输出维度。另一个问题是,根据用于确定捆绑连接的阈值超参数的设置,最终获得的模块化结构会发生很大变化。在本文中,我们提出了一种新的方法来定量解释的作用,每个社区的推理,通过定义的影响,每个输入维度上的社区,和社区的影响,对每个输出维度。我们的实验表明,我们提出的方法可以揭示分层神经网络的每个部分的作用,通过将神经网络应用到三种类型的数据集,从训练的网络中提取社区,并将所提出的方法应用到社区结构。
英文摘要:
A layered neural network is now one of the most common choices for the prediction of high-dimensional practical data sets, where the relationship between input and output data is complex and cannot be represented well by simple conventional models. Its effectiveness is shown in various tasks, however, the lack of interpretability of the trained result by a layered neural network has limited its application area. In our previous studies, we proposed methods for extracting a simplified global structure of a trained layered neural network by classifying the units into communities according to their connection patterns with adjacent layers. These methods provided us with knowledge about the strength of the relationship between communities from the existence of bundled connections, which are determined by threshold processing of the connection ratio between pairs of communities. However, it has been difficult to understand the role of each community quantitatively by observing the modular structure. We could only know to which sets of the input and output dimensions each community was mainly connected, by tracing the bundled connections from the community to the input and output layers. Another problem is that the finally obtained modular structure is changed greatly depending on the setting of the threshold hyperparameter used for determining bundled connections. In this paper, we propose a new method for interpreting quantitatively the role of each community in inference, by defining the effect of each input dimension on a community, and the effect of a community on each output dimension. We show experimentally that our proposed method can reveal the role of each part of a layered neural network by applying the neural networks to three types of data sets, extracting communities from the trained network, and applying the proposed method to the community structure.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。