arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1810.01588stat.MLcs.LG
收藏

分层神经网络的层次模块表示

Interpreting Layered Neural Networks via Hierarchical Modular Representation

NTT Communication Science Laboratories(NTT通信科学实验室)

Chihiro Watanabe

摘要:

解释复杂模型的预测机制是目前机器学习领域最重要的任务之一,特别是分层神经网络,它已经在各种实际数据集上取得了很高的预测性能。为了以一种可解释的方式揭示一个训练好的神经网络的全局结构,已经提出了一系列的聚类方法,这些方法根据推理角色的相似性将单元分解成簇。这些研究中的主要问题是:(1)我们没有关于分解的最佳分辨率或适当的聚类数量的先验知识,以及(2)没有方法来获取关于每个聚类的输出是否与输入和输出维度值呈正相关或负相关的知识。在本文中,为了解决这些问题,我们提出了一种方法,用于获得分层神经网络的分层模块化表示。层次聚类方法的训练网络的应用程序揭示了隐藏层单元之间的树结构的关系,根据其特征向量定义的输入和输出维度值的相关性。

英文摘要:

Interpreting the prediction mechanism of complex models is currently one of the most important tasks in the machine learning field, especially with layered neural networks, which have achieved high predictive performance with various practical data sets. To reveal the global structure of a trained neural network in an interpretable way, a series of clustering methods have been proposed, which decompose the units into clusters according to the similarity of their inference roles. The main problems in these studies were that (1) we have no prior knowledge about the optimal resolution for the decomposition, or the appropriate number of clusters, and (2) there was no method with which to acquire knowledge about whether the outputs of each cluster have a positive or negative correlation with the input and output dimension values. In this paper, to solve these problems, we propose a method for obtaining a hierarchical modular representation of a layered neural network. The application of a hierarchical clustering method to a trained network reveals a tree-structured relationship among hidden layer units, based on their feature vectors defined by their correlation with the input and output dimension values.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑