arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.22203stat.ME
收藏

局部贝叶斯回归

Local Bayesian Regression

University of Oslo(奥斯陆大学)

Nils Lid Hjort

AI总结:

本文提出了一种基于局部线性建模的贝叶斯方法,通过经验贝叶斯和分层贝叶斯技术实现非参数和半参数回归估计,在多个协变量情况下表现出色。

摘要:

本文开发了一类贝叶斯非参数和半参数方法,用于估计回归曲线和曲面。主要思想是将回归建模为局部线性,然后在局部参数上放置合适的局部先验。该方法需要在给定局部数据的情况下,找到局部参数的后验分布,这通过合适定义的局部似然函数来实现。当局部数据窗口宽度较大时,该方法会退化为熟悉的全参数贝叶斯方法,而当窗口宽度较小时,估计器本质上是非参数的。当使用非信息性参考先验时,所得到的估计器与最近开发的在非参数回归中表现良好的局部加权最小二乘方法一致。每个局部先验分布通常需要一个中心参数和一个方差参数。特别值得关注的是,某些版本的方案在某种程度上是自动的和客观的,即不需要主观指定先验参数。因此,我们开发了经验贝叶斯方法来获得方差参数,并采用分层贝叶斯方法来处理中心参数选择的不确定性。存在多种可能的通用程序版本,讨论了其多个特化版本。其中一些已被证明在多个协变量的情况下能够超越标准非参数回归方法。

英文摘要:

This paper develops a class of Bayesian non- and semiparametric methods for estimating regression curves and surfaces. The main idea is to model the regression as locally linear, and then place suitable local priors on the local parameters. The method requires the posterior distribution of the local parameters given local data, and this is found via a suitably defined local likelihood function. When the width of the local data window is large the methods reduce to familiar fully parametric Bayesian methods, and when the width is small the estimators are essentially nonparametric. When noninformative reference priors are used the resulting estimators coincide with recently developed well-performing local weighted least squares methods for nonparametric regression. Each local prior distribution needs in general a centre parameter and a variance parameter. Of particular interest are versions of the scheme that are more or less automatic and objective in the sense that they do not require subjective specifications of prior parameters. We therefore develop empirical Bayes methods to obtain the variance parameter and a hierarchical Bayes method to account for uncertainty in the choice of centre parameter. There are several possible versions of the general programme, and a number of its specialisations are discussed. Some of these are shown to be capable of outperforming standard nonparametric regression methods, particularly in situations with several covariates.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑