arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1805.00152cs.IR
收藏

序列相依模型的生成式与判别式的等价性

On the Equivalence of Generative and Discriminative Formulations of the Sequential Dependence Model

Laura Dietz, John Foley

摘要:

顺序依赖模型(SDM)是一种基于概率图模型理论的检索模型。虽然它最初是由Metzler和Croft作为马尔可夫随机场(又名判别概率模型)引入的,但在本文中,我们证明了它等价于生成概率模型。为了建立一个基础,为未来的检索模型,本文详细介绍了公理基础的SDM模型的歧视性和生成概率模型。唯一的区别是在对数空间或多项式空间中估计模型参数。我们表明,参数估计与网格调整产生负面影响的生成配方,当参数估计与坐标-梯度下降的效果消失。这是令人担忧的,因为经验上的差异可能被错误地归因于改进的模型。

英文摘要:

The sequential dependence model (SDM) is a popular retrieval model which is based on the theory of probabilistic graphical models. While it was originally introduced by Metzler and Croft as a Markov Random Field (aka discriminative probabilistic model), in this paper we demonstrate that it is equivalent to a generative probabilistic model. To build an foundation for future retrieval models, this paper details the axiomatic underpinning of the SDM model as discriminative and generative probabilistic model. The only difference arises whether model parameters are estimated in log-space or Multinomial-space. We demonstrate that parameter-estimation with grid-tuning is negatively impacting the generative formulation, an effect that vanishes when parameters are estimated with coordinate-gradient descent. This is concerning, since empirical differences may be falsely attributed to improved models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑