arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.01246cs.LGcs.AIstat.ML
收藏

一种避免过拟合的无超参数决策树构造方法

A Novel Hyperparameter-free Approach to Decision Tree Construction that Avoids Overfitting by Design

IMDEA Networks Institute(IMDEA网络研究所)

Rafael Garcia Leiva, Antonio Fernandez Anta, Vincenzo Mancuso, Paolo Casari

摘要:

决策树是一种非常流行的机器学习技术。不幸的是,过拟合在决策树仍然是一个开放的问题,有时会阻止实现良好的性能。在这项工作中,我们提出了一种新的方法来构建决策树,避免过度拟合的设计,而不会失去准确性。我们的算法的一个显着特点是,它既不需要优化任何超参数,也不使用正则化技术,从而显着减少了决策树的训练时间。此外,我们的算法产生更小,更浅的树比传统算法,促进所产生的模型的可解释性。

英文摘要:

Decision trees are an extremely popular machine learning technique. Unfortunately, overfitting in decision trees still remains an open issue that sometimes prevents achieving good performance. In this work, we present a novel approach for the construction of decision trees that avoids the overfitting by design, without losing accuracy. A distinctive feature of our algorithm is that it requires neither the optimization of any hyperparameters, nor the use of regularization techniques, thus significantly reducing the decision tree training time. Moreover, our algorithm produces much smaller and shallower trees than traditional algorithms, facilitating the interpretability of the resulting models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑