arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.11941stat.ME
收藏

具有均值和方差异常检测和Oracle属性的双重鲁棒特征选择

Doubly Robust Feature Selection with Mean and Variance Outlier Detection and Oracle Properties

Luca Insolia, Francesca Chiaromonte, Runze Li, Marco Riani

摘要:

我们提出了一个通用的方法来处理数据污染,可能会破坏性能的特征选择和估计过程的高维线性模型。具体来说,我们认为共同出现的均值漂移和方差膨胀离群值,这可以建模为额外的固定和随机组件,分别独立评估。我们的建议执行特征选择,同时检测和降低方差膨胀离群值的权重,检测和排除均值漂移离群值,并保留具有全权重的非离群情况。特征选择和均值漂移离群值检测是通过一类鲁棒的非凹惩罚方法进行的。方差膨胀离群值检测是基于惩罚的限制后验模式。由此产生的方法满足一个强大的Oracle属性的特征选择中存在的数据污染-这使得功能的数量以指数方式增加的样本量-和检测真正离群的情况下,每种类型的渐近概率1。这提供了高击穿点和效率之间的最佳折衷。计算效率的启发式程序。我们通过广泛的模拟研究和实际应用说明了我们的建议的有限样本性能。

英文摘要:

We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and variance-inflation outliers, which can be modeled as additional fixed and random components, respectively, and evaluated independently. Our proposal performs feature selection while detecting and down-weighting variance-inflation outliers, detecting and excluding mean-shift outliers, and retaining non-outlying cases with full weights. Feature selection and mean-shift outlier detection are performed through a robust class of nonconcave penalization methods. Variance-inflation outlier detection is based on the penalization of the restricted posterior mode. The resulting approach satisfies a robust oracle property for feature selection in the presence of data contamination -- which allows the number of features to exponentially increase with the sample size -- and detects truly outlying cases of each type with asymptotic probability one. This provides an optimal trade-off between a high breakdown point and efficiency. Computationally efficient heuristic procedures are also presented. We illustrate the finite-sample performance of our proposal through an extensive simulation study and a real-world application.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑