具有高度相关预测因子的稀疏回归
Sparse regression with highly correlated predictors
摘要:
我们考虑线性回归$y=Xβ+u$,其中$X\in\mathbb{\mathbb{R}}^{n\times p}$,$p\gg n,$和$β$是$s$ -稀疏的.受金融和经济数据示例的启发,我们考虑$X$具有高度相关和聚集列的情况。为了在这种情况下执行稀疏恢复,我们引入了\emph{clustering removal algorithm}(CRA),它试图通过在不改变参数向量$β$的情况下删除聚类结构来降低$X$中的相关性。我们证明了只要对$X$的某些假设成立,解相关矩阵将以很高的概率满足限制等距性(RIP)。我们还提供了CRA的经验性能的例子,并将其与其他稀疏恢复技术进行比较。
英文摘要:
We consider a linear regression $y=Xβ+u$ where $X\in\mathbb{\mathbb{R}}^{n\times p}$, $p\gg n,$ and $β$ is $s$-sparse. Motivated by examples in financial and economic data, we consider the situation where $X$ has highly correlated and clustered columns. To perform sparse recovery in this setting, we introduce the \emph{clustering removal algorithm} (CRA), that seeks to decrease the correlation in $X$ by removing the cluster structure without changing the parameter vector $β$. We show that as long as certain assumptions hold about $X$, the decorrelated matrix will satisfy the restricted isometry property (RIP) with high probability. We also provide examples of the empirical performance of CRA and compare it with other sparse recovery techniques.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。