arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.02112stat.MEcs.LGstat.ML
收藏

GP-BART:一种使用 Gaussian processes 的新型 Bayesian additive regression trees 方法

GP-BART: a novel Bayesian additive regression trees approach using Gaussian processes

Maynooth University(梅努斯大学);Hamilton Institute(汉密尔顿研究所);Insight Centre for Data Analytics(洞察数据分析中心)

Mateus Maia, Keefe Murphy, Andrew C. Parnell

AI总结:

针对标准 BART 缺乏平滑性和显式协方差结构的局限,提出 GP-BART 模型,通过为所有树的终端节点预测假设 Gaussian process 先验进行扩展,在模拟与真实数据中超越传统方法。

摘要:

Bayesian additive regression trees (BART) 模型是一种集成方法,因其持续强大的预测性能和量化不确定性的能力,在回归任务中被广泛且成功地使用。BART 通过一组收缩先验组合“弱”树模型,每棵树解释数据中一小部分变异性。然而,标准 BART 缺乏平滑性且对观测值缺乏显式协方差结构,在需要这些假设的情况下可能导致性能不佳。Gaussian processes Bayesian additive regression trees (GP-BART) 模型是 BART 的扩展,通过假设所有树中每个终端节点的预测具有 Gaussian process (GP) 先验来解决此限制。通过应用于模拟和真实数据,展示了该模型的有效性,在多种场景中超越了传统建模方法的性能。

英文摘要:

The Bayesian additive regression trees (BART) model is an ensemble method extensively and successfully used in regression tasks due to its consistently strong predictive performance and its ability to quantify uncertainty. BART combines "weak" tree models through a set of shrinkage priors, whereby each tree explains a small portion of the variability in the data. However, the lack of smoothness and the absence of an explicit covariance structure over the observations in standard BART can yield poor performance in cases where such assumptions would be necessary. The Gaussian processes Bayesian additive regression trees (GP-BART) model is an extension of BART which addresses this limitation by assuming Gaussian process (GP) priors for the predictions of each terminal node among all trees. The model's effectiveness is demonstrated through applications to simulated and real-world data, surpassing the performance of traditional modeling approaches in various scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑