arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.15766math.STstat.MEstat.MLstat.TH
收藏

使用I-prior的加性交互建模

Additive interaction modelling using I-priors

Wicher Bergsma, Haziq Jamil

AI总结:

针对带交互项的加性回归模型估计与选择难题,研究将I-prior方法扩展至多协变量场景,提出交互模型简约设定,既简化参数估计又支持基于边际似然的模型选择。

摘要:

带交互项的加性回归模型已在文献中被广泛研究,常用方法包括样条或高斯过程回归。但这类方法存在估计和模型选择的难题,原因是平滑参数众多且缺乏合适的选择准则。我们通过将I-prior方法(Bergsma, 2020)扩展至多协变量(可为多维)的场景来解决这些挑战。I-prior方法在理论和实践层面均优于高斯过程回归、Tikhonov正则化等其他方法:它是一种真先验,基于最少假设,能得到可容许的后验均值,且尺度(即平滑)参数可通过E步和M步都很简单的EM算法进行估计。此外,我们提出了一种带交互项模型的简约设定,该设定有两个优势:(1)减少了尺度参数的数量,从而简化了带交互项模型的估计;(2)使得基于边际似然在(含不同交互项的)模型间进行直接的模型选择成为可能。

英文摘要:

Additive regression models with interactions are widely studied in the literature, using methods such as splines or Gaussian process regression. However, these methods can pose challenges for estimation and model selection, due to the presence of many smoothing parameters and the lack of suitable criteria. We propose to address these challenges by extending the I-prior methodology (Bergsma, 2020) to multiple covariates, which may be multidimensional. The I-prior methodology has some advantages over other methods, such as Gaussian process regression and Tikhonov regularization, both theoretically and practically. In particular, the I-prior is a proper prior, is based on minimal assumptions, yields an admissible posterior mean, and estimation of the scale (or smoothing) parameters can be done using an EM algorithm with simple E and M steps. Moreover, we introduce a parsimonious specification of models with interactions, which has two benefits: (i) it reduces the number of scale parameters and thus facilitates the estimation of models with interactions, and (ii) it enables straightforward model selection (among models with different interactions) based on the marginal likelihood.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑