arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1202.3746cs.LGstat.ML
收藏

基于离散能量模型确定性估计的渐近有效性:比率匹配和伪随机估计

Asymptotic Efficiency of Deterministic Estimators for Discrete Energy-Based Models: Ratio Matching and Pseudolikelihood

University of British Columbia(不列颠哥伦比亚大学)

Benjamin Marlin, Nando de Freitas

摘要:

标准的最大似然估计不能适用于离散的基于能量的模型在一般情况下,因为精确的模型概率的计算是棘手的。最近的研究已经看到了几个新的估计量的建议,专门设计来克服这个棘手的问题,但几乎没有什么是知道他们的理论性质。在本文中,我们提出了一个广义估计,统一了许多经典和最近提出的估计。我们使用M-估计量的标准渐近理论的结果,推导出我们的广义估计量的渐近协方差矩阵的通用表达式。我们应用这些结果来研究经典pseudolikraphy和最近提出的比率匹配估计的相对统计效率。

英文摘要:

Standard maximum likelihood estimation cannot be applied to discrete energy-based models in the general case because the computation of exact model probabilities is intractable. Recent research has seen the proposal of several new estimators designed specifically to overcome this intractability, but virtually nothing is known about their theoretical properties. In this paper, we present a generalized estimator that unifies many of the classical and recently proposed estimators. We use results from the standard asymptotic theory for M-estimators to derive a generic expression for the asymptotic covariance matrix of our generalized estimator. We apply these results to study the relative statistical efficiency of classical pseudolikelihood and the recently-proposed ratio matching estimator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑