arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1704.00566math.STstat.MEstat.TH
收藏

具有高维估计方程的惩罚经验似然的新范围

A new scope of penalized empirical likelihood with high-dimensional estimating equations

Jinyuan Chang, Cheng Yong Tang, Tong Tong Wu

摘要:

统计方法与经验似然(EL)是有吸引力的和有效的,特别是与估计方程,通过它可以自适应地和灵活地纳入有用的数据信息。它也是已知的,在文献中,EL方法遇到困难时,处理具有高维模型参数和估计方程的问题。为了克服这些挑战,我们从一个新的角度对高维EL进行了深入的研究,目标是估计高维稀疏模型的参数。我们表明,新的范围提供了一个机会,放宽严格的要求的模型参数的维数。在此基础上,我们提出了一种新的惩罚EL,即在EL的优化过程中,通过引入两个罚函数分别正则化模型参数和相应的Lagrange乘子.通过惩罚拉格朗日乘子,以鼓励其稀疏性,我们表明,大幅减少维数的估计方程的数量可以有效地实现,而不会损害所得到的估计的有效性和一致性。最吸引人的是,这种估计方程的降维实际上相当于在这些高维估计方程中进行选择,从而导致用于高维稀疏模型参数的高度简约和有效的装置。在模型参数和估计方程的维数都随样本量呈指数增长的情况下,我们的理论证明了新惩罚EL的估计量是稀疏的,并且与渐近正态分布的非零分量一致.数值模拟和实际数据分析表明,所提出的惩罚EL的工作前景。

英文摘要:

Statistical methods with empirical likelihood (EL) are appealing and effective especially in conjunction with estimating equations through which useful data information can be adaptively and flexibly incorporated. It is also known in the literature that EL approaches encounter difficulties when dealing with problems having high-dimensional model parameters and estimating equations. To overcome the challenges, we begin our study with a careful investigation on high-dimensional EL from a new scope targeting at estimating a high-dimensional sparse model parameters. We show that the new scope provides an opportunity for relaxing the stringent requirement on the dimensionality of the model parameter. Motivated by the new scope, we then propose a new penalized EL by applying two penalty functions respectively regularizing the model parameters and the associated Lagrange multipliers in the optimizations of EL. By penalizing the Lagrange multiplier to encourage its sparsity, we show that drastic dimension reduction in the number of estimating equations can be effectively achieved without compromising the validity and consistency of the resulting estimators. Most attractively, such a reduction in dimensionality of estimating equations is actually equivalent to a selection among those high-dimensional estimating equations, resulting in a highly parsimonious and effective device for high-dimensional sparse model parameters. Allowing both the dimensionalities of model parameters and estimating equations growing exponentially with the sample size, our theory demonstrates that the estimator from our new penalized EL is sparse and consistent with asymptotically normally distributed nonzero components. Numerical simulations and a real data analysis show that the proposed penalized EL works promisingly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑