arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1306.3171stat.MEcs.ITcs.LGmath.IT
收藏

高维回归的置信区间和假设检验

Confidence Intervals and Hypothesis Testing for High-Dimensional Regression

Stanford University(斯坦福大学)

Adel Javanmard, Andrea Montanari

摘要:

拟合高维统计模型通常需要使用非线性参数估计过程。因此,通常不可能获得参数估计值的概率分布的精确表征。这又意味着量化与某个参数估计值相关的\emph{uncertainty}极具挑战性。具体地说,不存在普遍接受的程序来计算经典的测量不确定性和统计显著性的置信区间或$p$ -这些模型的值。本文考虑高维线性回归问题,提出了一种构造置信区间和$p$值的有效算法。得到的置信区间具有接近最佳的大小。当测试某个参数为零的原假设时,我们的方法具有接近最优的功效。我们的方法是基于构建一个“去偏”版本的正则化M-估计。新的结构改进了该领域的最新工作,因为它没有假设设计矩阵上的特殊结构。我们测试我们的方法合成数据和高通量的基因组数据集核黄素生产率。

英文摘要:

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the parameter estimates. This in turn implies that it is extremely challenging to quantify the \emph{uncertainty} associated with a certain parameter estimate. Concretely, no commonly accepted procedure exists for computing classical measures of uncertainty and statistical significance as confidence intervals or $p$-values for these models. We consider here high-dimensional linear regression problem, and propose an efficient algorithm for constructing confidence intervals and $p$-values. The resulting confidence intervals have nearly optimal size. When testing for the null hypothesis that a certain parameter is vanishing, our method has nearly optimal power. Our approach is based on constructing a `de-biased' version of regularized M-estimators. The new construction improves over recent work in the field in that it does not assume a special structure on the design matrix. We test our method on synthetic data and a high-throughput genomic data set about riboflavin production rate.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑