arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.09299stat.MEmath.STstat.COstat.OTstat.TH
收藏

高维线性回归中模型和系数的有限样本和大样本推断:基于可重复样本框架

Finite- and Large- Sample Inference for Model and Coefficients in High-dimensional Linear Regression with Repro Samples

Peng Wang, Min-Ge Xie, Linjun Zhang

AI总结:

本文提出基于可重复样本框架的高维线性回归模型和系数推断方法,通过Fisher反推技术构建置信集,解决模型选择不确定性及有限样本性能问题。

摘要:

本文提出了一种新颖且有效的推断方法,用于进行高维线性回归模型的有限样本和大样本推断。该方法是在所谓的可重复样本框架下开发的,其中我们通过模仿数据的抽样机制来创建并研究人工样本的行为。我们为(a)对应非零系数的真实模型、(b)单个或任意一组回归系数,以及(c)模型和回归系数联合构建置信集。为了促进这些置信集的构建并克服搜索所有可能模型的计算困难,我们使用了一种创新的Fisher反推技术来构建一个候选模型集,该集在具有高斯和非高斯误差的模型中,以接近1的概率包含真实的稀疏模型。所提出的方法填补了高维回归文献中的两个主要空白:(1)缺乏有效的方法来处理模型选择不确定性并为真实模型提供有效的推断;(2)缺乏有效推断方法来保证有限样本性能。我们提供了有限样本和渐近结果,以理论保证所提出方法的性能。此外,我们的数值结果表明,所提出的方法是有效的,并且在置信集更小的情况下,覆盖性能优于当前最先进的方法,如去偏差和bootstrap方法。

英文摘要:

In this paper, we present a novel and effective inference approach to conduct both finite- and large-sample inference for high-dimensional linear regression models. This approach is developed under the so-called repro samples framework, in which we conduct statistical inference by creating and studying the behavior of artificial samples that are obtained by mimicking the sampling mechanism of the data. We construct confidence sets for (a) the true model corresponding to the nonzero coefficients, (b) a single or any collection of regression coefficients, and (c) both the model and regression coefficients jointly. To facilitate the constructions of these confidence sets and overcome computational difficulties of searching all possible models, we use an innovative Fisher inversion technique to construct a model candidate set that includes the true sparse model with the probability close to 1 for models with both Gaussian and non-Gaussian errors. The proposed approach fills in two major gaps in the high-dimensional regression literature: (1) lack of effective approaches to addressing model selection uncertainty and providing valid inference for the underlying true model; (2) lack of effective inference approaches to guaranteeing finite-sample performance. We provide both finite-sample and asymptotic results to theoretically guarantee the performance of the proposed methods. In addition, our numerical results demonstrate that the proposed methods are valid and achieve better coverage with smaller confidence sets than the current state-of-the-art approaches, such as debiasing and bootstrap approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑