arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.00045cs.LGcs.AIstat.ML
收藏

高斯条件随机场分类

Gaussian Conditional Random Fields for Classification

Faculty of Organizational Sciences, University of Belgrade(贝尔格莱德大学组织科学学院);Faculty of Mathematics, University of Belgrade(贝尔格莱德大学数学学院)

Andrija Petrović, Mladen Nikolić, Miloš Jovanović, Boris Delibašić

摘要:

高斯条件随机场(Gaussian Conditional Random Fields,GCRF)是一种常用的连续输出结构化模型,它使用多个非结构化预测因子来形成其特征,同时利用输出之间的依赖结构,这是由相似性度量提供的。提出了一种用于结构化二元分类的高斯条件随机场模型。该模型适用于无向图的分类问题,难以为标准分类CRF。GCRFBC的模型表示扩展的潜变量,产生一些有吸引力的属性。由于GCRF的潜在结构,该模型变得易于处理,高效,并开放以前应用于GCRF回归模型的改进。此外,该模型允许减少噪声,如果结构直接定义在离散输出之间,则可能出现噪声。此外,提出了两种不同形式的算法:GCRFBCb(GCRGBC -贝叶斯)和GCRFBCnb(GCRFBC -非贝叶斯)。在贝叶斯GCRFBCb变体中,使用扩展的sigmoid函数局部变分逼近方法求解经验贝叶斯,而在GCRFBCnb变体中,隐变量的MAP值是学习和推理的基础。GCRFCB中的推论由一维积分的Newton-Cotes公式求解。这两个模型进行评估的合成数据和现实世界的数据。结果表明,这两种模型实现更好的预测性能比非结构化的预测。此外,计算和内存的复杂性进行了评估。详细讨论了GCRFBCb和GCRFBCnb的优缺点。

英文摘要:

Gaussian conditional random fields (GCRF) are a well-known used structured model for continuous outputs that uses multiple unstructured predictors to form its features and at the same time exploits dependence structure among outputs, which is provided by a similarity measure. In this paper, a Gaussian conditional random fields model for structured binary classification (GCRFBC) is proposed. The model is applicable to classification problems with undirected graphs, intractable for standard classification CRFs. The model representation of GCRFBC is extended by latent variables which yield some appealing properties. Thanks to the GCRF latent structure, the model becomes tractable, efficient and open to improvements previously applied to GCRF regression models. In addition, the model allows for reduction of noise, that might appear if structures were defined directly between discrete outputs. Additionally, two different forms of the algorithm are presented: GCRFBCb (GCRGBC - Bayesian) and GCRFBCnb (GCRFBC - non Bayesian). The extended method of local variational approximation of sigmoid function is used for solving empirical Bayes in Bayesian GCRFBCb variant, whereas MAP value of latent variables is the basis for learning and inference in the GCRFBCnb variant. The inference in GCRFBCb is solved by Newton-Cotes formulas for one-dimensional integration. Both models are evaluated on synthetic data and real-world data. It was shown that both models achieve better prediction performance than unstructured predictors. Furthermore, computational and memory complexity is evaluated. Advantages and disadvantages of the proposed GCRFBCb and GCRFBCnb are discussed in detail.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑