RENT --用于特征选择的重复弹性网技术
RENT -- Repeated Elastic Net Technique for Feature Selection
摘要:
特征选择是数据科学管道中的一个重要步骤,可以降低与大型数据集相关的复杂性。虽然这方面的研究主要集中在优化预测性能,但很少有研究在特征选择过程的背景下调查稳定性。在这项研究中,我们提出了重复弹性网络技术(重复)的特征选择。SVM使用具有弹性网络正则化的广义线性模型的集合,每个模型在训练数据的不同子集上训练。特征选择基于三个标准,评估所有基本模型中特征的权重分布。这一事实导致选择具有高稳定性的特征,从而提高最终模型的鲁棒性。此外,与已建立的特征选择器不同,SVM为模型解释提供了有价值的信息,这些信息涉及在训练期间难以预测的数据中的对象的识别。在我们的实验中,我们对六个已建立的特征选择器在八个多元数据集上进行二进制分类和回归的基准测试。在实验比较中,ESTA显示了预测性能和稳定性之间的平衡。最后,我们通过对医疗数据集的探索性事后分析,强调了ESTA的额外解释价值。
英文摘要:
Feature selection is an essential step in data science pipelines to reduce the complexity associated with large datasets. While much research on this topic focuses on optimizing predictive performance, few studies investigate stability in the context of the feature selection process. In this study, we present the Repeated Elastic Net Technique (RENT) for Feature Selection. RENT uses an ensemble of generalized linear models with elastic net regularization, each trained on distinct subsets of the training data. The feature selection is based on three criteria evaluating the weight distributions of features across all elementary models. This fact leads to the selection of features with high stability that improve the robustness of the final model. Furthermore, unlike established feature selectors, RENT provides valuable information for model interpretation concerning the identification of objects in the data that are difficult to predict during training. In our experiments, we benchmark RENT against six established feature selectors on eight multivariate datasets for binary classification and regression. In the experimental comparison, RENT shows a well-balanced trade-off between predictive performance and stability. Finally, we underline the additional interpretational value of RENT with an exploratory post-hoc analysis of a healthcare dataset.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。