arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1810.04443math.STstat.COstat.MEstat.TH
收藏

高维模拟估计的性质

On the Properties of Simulation-based Estimators in High Dimensions

Stéphane Guerrier, Mucyo Karemera, Samuel Orso, Maria-Pia Victoria-Feser

摘要:

考虑到可用数据的规模不断增加,对控制有限样本偏差的统计方法的需求也在增长。这主要是由于频繁设置,其中变量的数量很大,并且允许随着样本量的增加而增加,从而使标准推理程序在性能方面遭受重大损失。此外,统计模型的复杂性也在增加,从而在构建新的估计量或实施经典的计算带来了重要的挑战。数值复杂性和统计特性之间的权衡往往是可以接受的。然而,在高维问题中,完全无偏、一致和渐近正态的数值有效估计通常是理想的。在本文中,我们设置了一个通用的框架,这样的估计可以很容易地推导出广泛的模型类。该框架基于间接推理等基于模拟的估计方法的基础概念。与以前的结果相比,该方法允许各种扩展,因为它适用于可能不一致的估计量,并且适用于离散模型和/或具有大量参数的模型。我们考虑一种算法,即迭代Bootstrap(IB),有效地计算基于模拟的估计,显示其收敛性。在这个框架内,我们还证明了基于模拟的估计的性质,更具体地说,无偏性,一致性和渐近正态性的参数的数量允许增加的样本量时。因此,所提出的方法的一个重要含义是,它允许在有限样本中获得无偏估计。最后,我们研究了这种方法时,应用到三个常见的模型,即逻辑斯谛回归,负二项回归和套索回归。

英文摘要:

Considering the increasing size of available data, the need for statistical methods that control the finite sample bias is growing. This is mainly due to the frequent settings where the number of variables is large and allowed to increase with the sample size bringing standard inferential procedures to incur significant loss in terms of performance. Moreover, the complexity of statistical models is also increasing thereby entailing important computational challenges in constructing new estimators or in implementing classical ones. A trade-off between numerical complexity and statistical properties is often accepted. However, numerically efficient estimators that are altogether unbiased, consistent and asymptotically normal in high dimensional problems would generally be ideal. In this paper, we set a general framework from which such estimators can easily be derived for wide classes of models. This framework is based on the concepts that underlie simulation-based estimation methods such as indirect inference. The approach allows various extensions compared to previous results as it is adapted to possibly inconsistent estimators and is applicable to discrete models and/or models with a large number of parameters. We consider an algorithm, namely the Iterative Bootstrap (IB), to efficiently compute simulation-based estimators by showing its convergence properties. Within this framework we also prove the properties of simulation-based estimators, more specifically the unbiasedness, consistency and asymptotic normality when the number of parameters is allowed to increase with the sample size. Therefore, an important implication of the proposed approach is that it allows to obtain unbiased estimators in finite samples. Finally, we study this approach when applied to three common models, namely logistic regression, negative binomial regression and lasso regression.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑