arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.08459cs.LGcs.AI

Rule Extraction from Binary Neural Networks with Convolutional Rules for Model Validation

TU Kaiserslautern(凯泽斯劳滕工业大学);University of Mainz(美因茨大学);Johannes Gutenberg University of Mainz(约翰内斯·古腾堡大学美因茨分校);TU Darmstadt(达姆施塔特工业大学)

Sophie Burkhardt, Jannis Brugger, Nicolas Wagner, Zahra Ahmadi, Kristian Kersting, Stefan Kramer

英文摘要:

Most deep neural networks are considered to be black boxes, meaning their output is hard to interpret. In contrast, logical expressions are considered to be more comprehensible since they use symbols that are semantically close to natural language instead of distributed representations. However, for high-dimensional input data such as images, the individual symbols, i.e. pixels, are not easily interpretable. We introduce the concept of first-order convolutional rules, which are logical rules that can be extracted using a convolutional neural network (CNN), and whose complexity depends on the size of the convolutional filter and not on the dimensionality of the input. Our approach is based on rule extraction from binary neural networks with stochastic local search. We show how to extract rules that are not necessarily short, but characteristic of the input, and easy to visualize. Our experiments show that the proposed approach is able to model the functionality of the neural network while at the same time producing interpretable logical rules.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑