LEURN:用神经网络学习可解释的单变量规则
LEURN: Learning Explainable Univariate Rules with Neural Networks
摘要:
在本文中,我们提出了LEURN:一个神经网络架构,学习单变量决策规则。LEURN是一个白盒算法,它可以生成单变量树,并在每个阶段做出可解释的决策。在每一层中,LEURN根据先前检查的规则及其相应响应的嵌入找到一组单变量规则。规则发现和最终决策机制都是这些嵌入的加权线性组合,因此所有规则的贡献都是明确的,可解释的。LEURN可以选择特征,提取特征重要性,提供一对样本之间的语义相似性,以生成的方式使用,并可以给出置信度得分。由于平滑参数,LEURN还可以像决策树或普通神经网络一样可控地表现。除了这些优点之外,LEURN在30个表格数据集上实现了与最先进的方法相当的性能,用于分类和回归问题。
英文摘要:
In this paper, we propose LEURN: a neural network architecture that learns univariate decision rules. LEURN is a white-box algorithm that results into univariate trees and makes explainable decisions in every stage. In each layer, LEURN finds a set of univariate rules based on an embedding of the previously checked rules and their corresponding responses. Both rule finding and final decision mechanisms are weighted linear combinations of these embeddings, hence contribution of all rules are clearly formulated and explainable. LEURN can select features, extract feature importance, provide semantic similarity between a pair of samples, be used in a generative manner and can give a confidence score. Thanks to a smoothness parameter, LEURN can also controllably behave like decision trees or vanilla neural networks. Besides these advantages, LEURN achieves comparable performance to state-of-the-art methods across 30 tabular datasets for classification and regression problems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。