arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1910.01396math.STstat.MEstat.MLstat.TH
收藏

约束下的极大似然:退化和随机临界点

Maximum Likelihood under constraints: Degeneracies and Random Critical Points

Subhro Ghosh, Sanjay Chaudhuri

摘要:

本文研究了在汇总统计量约束下的半参数极大似然估计问题。这样的过程导致离散的概率分布,其在指定的约束(称为估计方程)下使所有此类分布中的似然最大化,并且是基本总体分布的近似。对这种经验可能性的研究起源于欧文的开创性工作。我们调查这个过程中设置错误指定(或有偏)的估计方程,即当原假设是不正确的。我们建立的行为下,这种错误的规格的最优分布显着不同的性质下的零,即当估计方程是无偏的,并正确指定。这表现为定义似然的最优分布中的某些退化。这种简并在零下是观察不到的。此外,我们建立了一个异常的行为的对数似然基于Wilks统计,这与下空,不表现出卡方极限。在贝叶斯设置中,我们严格地建立后验一致性的程序的基础上,这些想法,而不是一个参数似然,经验似然被用来定义的后验分布。特别是,我们表明,这后,作为一个随机的概率测度,迅速收敛到真正的参数值的δ测量。我们的方法的一个新的特点是调查的临界点的随机函数的背景下,这种经验的可能性。特别是,我们得到的位置和质量的退化的最佳权重作为领导和子领导项在一个典型的扩展的一个特定的临界点的随机函数,自然与模型。

英文摘要:

We investigate the problem of semi-parametric maximum likelihood under constraints on summary statistics. Such a procedure results in a discrete probability distribution that maximises the likelihood among all such distributions under the specified constraints (called estimating equations), and is an approximation to the underlying population distribution. The study of such empirical likelihood originates from the seminal work of Owen. We investigate this procedure in the setting of mis-specified (or biased) estimating equations, i.e. when the null hypothesis is not true. We establish that the behaviour of the optimal distribution under such mis-specification differ markedly from their properties under the null, i.e. when the estimating equations are unbiased and correctly specified. This is manifested by certain degeneracies in the optimal distribution which define the likelihood. Such degeneracies are not observed under the null. Furthermore, we establish an anomalous behaviour of the log-likelihood based Wilks statistic, which, unlike under the null, does not exhibit a chi-squared limit. In the Bayesian setting, we rigorously establish the posterior consistency of procedures based on these ideas, where instead of a parametric likelihood, an empirical likelihood is used to define the posterior distribution. In particular, we show that this posterior, as a random probability measure, rapidly converges to the delta measure at the true parameter value. A novel feature of our approach is the investigation of critical points of random functions in the context of such empirical likelihood. In particular, we obtain the location and the mass of the degenerate optimal weights as the leading and sub-leading terms in a canonical expansion of a particular critical point of a random function that is naturally associated with the model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑