arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.12165cs.LGcs.CV
收藏

LassoLayer:通过切换一对一链路的非线性特征选择

LassoLayer: Nonlinear Feature Selection by Switching One-to-one Links

Shizuoka University(静冈大学);ST Engineering Ltd.(新科工程有限公司);JAVIS CO., LTD.(JAVIS株式会社)

Akihito Sudo, Teng Teck Hou, Masaki Yamaguchi, Yoshinori Tone

摘要:

随着解决更复杂问题的需要,特征选择方法变得越来越重要。特征选择方法可以分为包装方法、过滤方法和嵌入方法。Lasso作为一种功能强大的嵌入式特征选择方法,引起了众多研究者的关注。然而,作为一种线性方法,Lasso的适用性受到限制。在这项工作中,我们提出了LassoLayer,它是一对一连接的,并通过L1优化进行训练,它可以删除不必要的单元进行预测。对于非线性特征选择,我们构建了LassoMLP:配备LassoLayer作为第一层的网络。因为我们可以在任何网络结构中插入LassoLayer,所以它可以利用神经网络的强度,适用于需要特征选择的任务。我们评估LassoMLP在特征选择回归和分类任务。LassoMLP接收的特征包括相当数量的噪声因素,这对过拟合是有害的。在使用MNIST数据集的实验中,我们确认LassoMLP优于最先进的方法。

英文摘要:

Along with the desire to address more complex problems, feature selection methods have gained in importance. Feature selection methods can be classified into wrapper method, filter method, and embedded method. Being a powerful embedded feature selection method, Lasso has attracted the attention of many researchers. However, as a linear approach, the applicability of Lasso has been limited. In this work, we propose LassoLayer that is one-to-one connected and trained by L1 optimization, which work to drop out unnecessary units for prediction. For nonlinear feature selections, we build LassoMLP: the network equipped with LassoLayer as its first layer. Because we can insert LassoLayer in any network structure, it can harness the strength of neural network suitable for tasks where feature selection is needed. We evaluate LassoMLP in feature selection with regression and classification tasks. LassoMLP receives features including considerable numbers of noisy factors that is harmful for overfitting. In the experiments using MNIST dataset, we confirm that LassoMLP outperforms the state-of-the-art method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑