arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1302.1545cs.LGstat.ML
收藏

回归和分类的模型和选择标准

Models and Selection Criteria for Regression and Classification

Microsoft Research(微软研究院)

David Heckerman, Christopher Meek

摘要:

当进行回归或分类时,我们感兴趣的是给定一组输入变量X的结果或类变量Y的条件概率分布。我们考虑贝叶斯模型来完成这项任务。特别是,我们研究了一类特殊的模型,我们称之为贝叶斯回归/分类(BRC)模型,它可以分解为独立的条件(y| x)和输入(x)模型。这些模型很方便,因为条件模型(我们关心的完整模型的一部分)可以自己分析。我们研究了将任意贝叶斯模型转换为BRC模型的做法,并认为这种做法通常是不合适的,因为它忽略了可能对学习很重要的先验知识。此外,我们还研究了从数据中学习模型的贝叶斯方法。我们讨论了适用于抑制/分类的贝叶斯模型选择的两个标准:Spiegelhalter等人(1993)和Buntine(1993)描述的一个。我们使用Dawid(1984)的前提框架对比了这两个准则,并给出了这两个准则一致的充分条件。

英文摘要:

When performing regression or classification, we are interested in the conditional probability distribution for an outcome or class variable Y given a set of explanatoryor input variables X. We consider Bayesian models for this task. In particular, we examine a special class of models, which we call Bayesian regression/classification (BRC) models, that can be factored into independent conditional (y|x) and input (x) models. These models are convenient, because the conditional model (the portion of the full model that we care about) can be analyzed by itself. We examine the practice of transforming arbitrary Bayesian models to BRC models, and argue that this practice is often inappropriate because it ignores prior knowledge that may be important for learning. In addition, we examine Bayesian methods for learning models from data. We discuss two criteria for Bayesian model selection that are appropriate for repression/classification: one described by Spiegelhalter et al. (1993), and another by Buntine (1993). We contrast these two criteria using the prequential framework of Dawid (1984), and give sufficient conditions under which the criteria agree.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑