arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.20120cs.LGstat.ME
收藏

用ADVI进行NUTS:利用Facebook Prophet探索各种贝叶斯推断技术

Going NUTS with ADVI: Exploring various Bayesian Inference techniques with Facebook Prophet

Faculty of Computer Science(计算机科学与工程系);Methodius University Skopje, Macedonia(Methodius大学斯科普耶分校,马其顿)

Jovan Krajevski, Biljana Tojtovska Ribarski

AI总结:

本文通过PyMC重新实现Facebook Prophet模型,探索并比较多种贝叶斯推断方法,分析其在时间序列预测中的应用与性能。

摘要:

自推出以来,Facebook Prophet吸引了经典统计学家和贝叶斯统计学界的高度关注。该模型提供了两种内置推断方法:使用L-BFGS-B算法的最大后验估计,以及通过No-U-Turn Sampler(NUTS)进行的马尔可夫链蒙特卡罗(MCMC)抽样。在利用贝叶斯推断解决各种时间序列预测问题时,我们遇到了无法应用除默认提供的替代推断技术的限制。此外,Facebook Prophet流畅的API设计在实现我们自定义建模想法时显得不够灵活。为了解决这些不足,我们开发了一个完整的PyMC重新实现的Prophet模型,使我们能够扩展基础模型并评估和比较多种贝叶斯推断方法。在本文中,我们展示了基于PyMC的实现,并详细分析了不同贝叶斯推断技术的实现。我们考虑了时间序列预测问题上的完整MCMC技术、最大后验估计和变分推断技术。我们详细讨论了抽样方法、收敛诊断、预测指标以及它们的计算效率,并检测到可能的问题,这些将在我们的未来工作中解决。

英文摘要:

Since its introduction, Facebook Prophet has attracted positive attention from both classical statisticians and the Bayesian statistics community. The model provides two built-in inference methods: maximum a posteriori estimation using the L-BFGS-B algorithm, and Markov Chain Monte Carlo (MCMC) sampling via the No-U-Turn Sampler (NUTS). While exploring various time-series forecasting problems using Bayesian inference with Prophet, we encountered limitations stemming from the inability to apply alternative inference techniques beyond those provided by default. Additionally, the fluent API design of Facebook Prophet proved insufficiently flexible for implementing our custom modeling ideas. To address these shortcomings, we developed a complete reimplementation of the Prophet model in PyMC, which enables us to extend the base model and evaluate and compare multiple Bayesian inference methods. In this paper, we present our PyMC-based implementation and analyze in detail the implementation of different Bayesian inference techniques. We consider full MCMC techniques, MAP estimation and Variational inference techniques on a time-series forecasting problem. We discuss in details the sampling approach, convergence diagnostics, forecasting metrics as well as their computational efficiency and detect possible issues which will be addressed in our future work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑