arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2002.09025stat.ME
收藏

使用Jackknife+-after-Bootstrap进行预测推理是免费的

Predictive Inference Is Free with the Jackknife+-after-Bootstrap

Byol Kim, Chen Xu, Rina Foygel Barber

摘要:

包围学习被广泛应用于复杂决策问题的预测--例如,平均模型拟合到从可用训练数据引导的样本序列。虽然这些方法提供了更准确,稳定和鲁棒的预测和模型估计,但关于如何对这些类型的过程的输出执行有效的,精简的推理的知识要少得多。在本文中,我们提出了刀切+后引导(J+aB),一个程序,用于构建一个预测区间,它只使用可用的自举样本和相应的拟合模型,因此是“免费”的模型拟合的成本。J+aB提供了一个预测覆盖率保证,它不需要对数据的分布、拟合模型的性质或模型集合的聚合方式进行任何假设-在最坏的情况下,预测区间的失败率被夸大了2倍。我们的数值实验验证了覆盖率和准确性的预测区间的真实数据。

英文摘要:

Ensemble learning is widely used in applications to make predictions in complex decision problems---for example, averaging models fitted to a sequence of samples bootstrapped from the available training data. While such methods offer more accurate, stable, and robust predictions and model estimates, much less is known about how to perform valid, assumption-lean inference on the output of these types of procedures. In this paper, we propose the jackknife+-after-bootstrap (J+aB), a procedure for constructing a predictive interval, which uses only the available bootstrapped samples and their corresponding fitted models, and is therefore "free" in terms of the cost of model fitting. The J+aB offers a predictive coverage guarantee that holds with no assumptions on the distribution of the data, the nature of the fitted model, or the way in which the ensemble of models are aggregated---at worst, the failure rate of the predictive interval is inflated by a factor of 2. Our numerical experiments verify the coverage and accuracy of the resulting predictive intervals on real data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑