arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.00410cs.LGcs.NEstat.ML
收藏

分类问题中基于非线性决策树分裂规则双层优化的可解释规则发现

Interpretable Rule Discovery Through Bilevel Optimization of Split-Rules of Nonlinear Decision Trees for Classification Problems

Michigan State University(密歇根州立大学)

Yashesh Dhebar, Kalyanmoy Deb

摘要:

对于涉及设计,控制,其他实际目的的监督分类问题,用户不仅有兴趣找到一个高精度的分类器,但他们也要求得到的分类器是容易解释的。虽然分类器的可解释性的定义可以因情况而异,但在这里,通过人类可解释的分类器,我们将其限制为用简单的数学术语表示。作为一种新的方法,我们表示一个简单的数学规则,使用非线性决策树(NLDT)的组合分类器。树的每个条件(非终端)节点表示涉及特征的非线性数学规则(分裂规则),以便将给定条件节点中的数据集划分为两个不重叠的子集。这种划分旨在最小化结果子节点的不纯性。通过限制每个条件节点上的分裂规则结构和决策树的深度,保证了分类器的可解释性。在一个给定的条件节点的非线性分裂规则是使用进化的双层优化算法,而上层集中在到达一个可解释的结构的分裂规则,较低的水平实现最合适的权重(系数)的规则的各个组成部分,以最大限度地减少净杂质的两个子节点。所提出的算法的性能证明了一些控制测试问题,现有的基准问题,和工业问题。两个到500个特征问题的结果是令人鼓舞的,并开辟了进一步的范围,应用所提出的方法,更具有挑战性和复杂的分类任务。

英文摘要:

For supervised classification problems involving design, control, other practical purposes, users are not only interested in finding a highly accurate classifier, but they also demand that the obtained classifier be easily interpretable. While the definition of interpretability of a classifier can vary from case to case, here, by a humanly interpretable classifier we restrict it to be expressed in simplistic mathematical terms. As a novel approach, we represent a classifier as an assembly of simple mathematical rules using a non-linear decision tree (NLDT). Each conditional (non-terminal) node of the tree represents a non-linear mathematical rule (split-rule) involving features in order to partition the dataset in the given conditional node into two non-overlapping subsets. This partitioning is intended to minimize the impurity of the resulting child nodes. By restricting the structure of split-rule at each conditional node and depth of the decision tree, the interpretability of the classifier is assured. The non-linear split-rule at a given conditional node is obtained using an evolutionary bilevel optimization algorithm, in which while the upper-level focuses on arriving at an interpretable structure of the split-rule, the lower-level achieves the most appropriate weights (coefficients) of individual constituents of the rule to minimize the net impurity of two resulting child nodes. The performance of the proposed algorithm is demonstrated on a number of controlled test problems, existing benchmark problems, and industrial problems. Results on two to 500-feature problems are encouraging and open up further scopes of applying the proposed approach to more challenging and complex classification tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑