稀疏估计量与Oracle性质或Hodges估计量的回归
Sparse Estimators and the Oracle Property, or the Return of Hodges' Estimator
摘要:
我们指出了一些陷阱有关的概念,一个预言家的财产,在范和李(2001年,2002年,2004年),这是令人想起著名的陷阱有关的霍奇斯估计。预言性质通常是估计量的稀疏性的结果。我们发现,任何估计满足稀疏性的最大风险收敛到上确界的损失函数,特别是,最大风险发散到无穷大时,损失函数是无界的。为了便于介绍,结果被设置在线性回归模型的框架中,但概括远远超出该设置。在Monte Carlo研究中,我们还评估了Fan和Li(2001)中引入的平滑截断绝对偏差(SCAD)估计量在有限样本中的问题程度。我们发现,这种估计可以在有限的样本中表现得相当差,其最坏情况下的性能相对于最大似然恶化时,估计被调谐到稀疏的样本量增加。
英文摘要:
We point out some pitfalls related to the concept of an oracle property as used in Fan and Li (2001, 2002, 2004) which are reminiscent of the well-known pitfalls related to Hodges' estimator. The oracle property is often a consequence of sparsity of an estimator. We show that any estimator satisfying a sparsity property has maximal risk that converges to the supremum of the loss function; in particular, the maximal risk diverges to infinity whenever the loss function is unbounded. For ease of presentation the result is set in the framework of a linear regression model, but generalizes far beyond that setting. In a Monte Carlo study we also assess the extent of the problem in finite samples for the smoothly clipped absolute deviation (SCAD) estimator introduced in Fan and Li (2001). We find that this estimator can perform rather poorly in finite samples and that its worst-case performance relative to maximum likelihood deteriorates with increasing sample size when the estimator is tuned to sparsity.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。