arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv physics/9701026physics.data-an
收藏

贝叶斯回归和分类的高斯过程模型的Monte Carlo实现

Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification

Radford M. Neal

摘要:

高斯过程是定义一个或多个输入变量的函数的先验分布的自然方式。在一个简单的非参数回归问题中,这样的函数给出了观察到的响应的高斯分布的平均值,高斯过程模型可以很容易地使用矩阵计算来实现,这些矩阵计算对于多达一千种情况的数据集是可行的。定义高斯过程的协方差函数的超参数可以使用马尔可夫链方法进行采样。其中噪声具有t分布的回归模型和用于分类应用的逻辑或概率单位模型可以通过采样以及用于观察的潜在值来实现。现在有软件可以实现这些方法,使用协方差函数与分层参数化。以这种方式定义的模型可以发现数据的高级属性,例如哪些输入与预测响应相关。

英文摘要:

Gaussian processes are a natural way of defining prior distributions over functions of one or more input variables. In a simple nonparametric regression problem, where such a function gives the mean of a Gaussian distribution for an observed response, a Gaussian process model can easily be implemented using matrix computations that are feasible for datasets of up to about a thousand cases. Hyperparameters that define the covariance function of the Gaussian process can be sampled using Markov chain methods. Regression models where the noise has a t distribution and logistic or probit models for classification applications can be implemented by sampling as well for latent values underlying the observations. Software is now available that implements these methods using covariance functions with hierarchical parameterizations. Models defined in this way can discover high-level properties of the data, such as which inputs are relevant to predicting the response.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑