arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2012.07671cs.LG
收藏

E2E-FS:一种端到端的神经网络特征选择方法

E2E-FS: An End-to-End Feature Selection Method for Neural Networks

CITIC Research Center(CITIC研究中心);Universidade da Coruña(拉科鲁尼亚大学)

Brais Cancela, Verónica Bolón-Canedo, Amparo Alonso-Betanzos

摘要:

经典的嵌入式特征选择算法通常分为两大类:基于树的算法和套索变体。这两种方法都集中在不同的方面:虽然基于树的算法提供了一个明确的解释,哪些变量被用来触发某个输出,套索般的方法牺牲了详细的解释,有利于提高其准确性。在本文中,我们提出了一种新的嵌入式特征选择算法,称为端到端特征选择(E2 E-FS),旨在以一种巧妙的方式提供准确性和可解释性。尽管有非凸正则化项,我们的算法,类似于套索方法,解决了梯度下降技术,引入了一些限制,迫使模型专门选择最大数量的功能,将随后使用的分类器。虽然这些是硬限制,但获得的实验结果表明,该算法可以与使用梯度下降算法训练的任何学习模型一起使用。

英文摘要:

Classic embedded feature selection algorithms are often divided in two large groups: tree-based algorithms and lasso variants. Both approaches are focused in different aspects: while the tree-based algorithms provide a clear explanation about which variables are being used to trigger a certain output, lasso-like approaches sacrifice a detailed explanation in favor of increasing its accuracy. In this paper, we present a novel embedded feature selection algorithm, called End-to-End Feature Selection (E2E-FS), that aims to provide both accuracy and explainability in a clever way. Despite having non-convex regularization terms, our algorithm, similar to the lasso approach, is solved with gradient descent techniques, introducing some restrictions that force the model to specifically select a maximum number of features that are going to be used subsequently by the classifier. Although these are hard restrictions, the experimental results obtained show that this algorithm can be used with any learning model that is trained using a gradient descent algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑