arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.09312math.OC
收藏

高维含变量误差回归的校正零范数正则化LS估计

Calibrated zero-norm regularized LS estimator for high-dimensional error-in-variables regression

Ting Tao, Shaohua Pan, Shujun Bi

摘要:

本文关注的是高维误差变量回归,旨在确定少量的重要的可解释的因素损坏的数据从许多应用中的测量误差或丢失的数据不能被忽略。受Datta和Zou \cite{Datta16}提出的CoCoLasso估计的启发,利用零范数正则化LS估计在干净数据下优于Lasso估计的优点,通过构造协变量的协方差阵的无偏替代项的正定投影的校准最小二乘损失,提出了校准零范数正则化LS(CaZnRLS)估计,并使用多阶段凸松弛方法计算CaZnRLS估计.在协变量真矩阵的约束特征值条件下,我们导出了每一步迭代的$\ell_2$ -误差界,并建立了误差界序列的递减性和有限步迭代的符号一致性.在两种测量误差下,给出了CaZnRLS估计量的统计保证.与CoCoLasso和NCL(Poh和Wainwright \cite{Loh11}提出的非凸Lasso)的数值比较表明,CaZnRLS不仅具有可比甚至更好的相对RSME,而且具有最少数量的错误预测。

英文摘要:

This paper is concerned with high-dimensional error-in-variables regression that aims at identifying a small number of important interpretable factors for corrupted data from many applications where measurement errors or missing data can not be ignored. Motivated by CoCoLasso due to Datta and Zou \cite{Datta16} and the advantage of the zero-norm regularized LS estimator over Lasso for clean data, we propose a calibrated zero-norm regularized LS (CaZnRLS) estimator by constructing a calibrated least squares loss with a positive definite projection of an unbiased surrogate for the covariance matrix of covariates, and use the multi-stage convex relaxation approach to compute the CaZnRLS estimator. Under a restricted eigenvalue condition on the true matrix of covariates, we derive the $\ell_2$-error bound of every iterate and establish the decreasing of the error bound sequence, and the sign consistency of the iterates after finite steps. The statistical guarantees are also provided for the CaZnRLS estimator under two types of measurement errors. Numerical comparisons with CoCoLasso and NCL (the nonconvex Lasso proposed by Poh and Wainwright \cite{Loh11}) demonstrate that CaZnRLS not only has the comparable or even better relative RSME but also has the least number of incorrect predictors identified.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑