arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.01289stat.ME
收藏

高维回归的随机测试:一个更有效和强大的解决方案

Randomized tests for high-dimensional regression: A more efficient and powerful solution

Yue Li, Ilmun Kim, Yuting Wei

摘要:

研究了当特征维数$p$与观测值$n$的个数成比例增长时,高维回归模型的全局零检验问题.尽管先前的一些工作研究这个问题,是否存在一个测试,是模型不可知的,有效的计算和享受高功率,仍然没有解决。在本文中,我们肯定地回答这个问题,利用随机投影技术,并提出了一个测试程序,融合了经典的$F$测试与随机投影步骤。当结合系统的选择的投影维数,所提出的方法被证明是最小最大优化,同时,减少了计算和数据存储的要求。我们说明了我们的结果在各种情况下,当底层特征矩阵表现出内在的低维结构(如近似块结构或具有指数/多项式特征衰减),事实证明,所提出的测试实现了尖锐的自适应率。我们的理论研究结果进一步验证了比较其他国家的最先进的测试的合成数据。

英文摘要:

We investigate the problem of testing the global null in the high-dimensional regression models when the feature dimension $p$ grows proportionally to the number of observations $n$. Despite a number of prior work studying this problem, whether there exists a test that is model-agnostic, efficient to compute and enjoys high power, still remains unsettled. In this paper, we answer this question in the affirmative by leveraging the random projection techniques, and propose a testing procedure that blends the classical $F$-test with a random projection step. When combined with a systematic choice of the projection dimension, the proposed procedure is proved to be minimax optimal and, meanwhile, reduces the computation and data storage requirements. We illustrate our results in various scenarios when the underlying feature matrix exhibits an intrinsic lower dimensional structure (such as approximate block structure or has exponential/polynomial eigen-decay), and it turns out that the proposed test achieves sharp adaptive rates. Our theoretical findings are further validated by comparisons to other state-of-the-art tests on the synthetic data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑