空时数据的预测与模型评估
Prediction & Model Evaluation for Space-Time Data
摘要:
对时空数据的预测误差、模型选择和模型平均的评价指标研究不足,理解不深。独立复制的缺乏使得预测作为一个概念模糊不清,并使独立数据开发的评估程序不适合大多数时空预测问题。受2008年加利福尼亚州野火期间收集的空气污染数据的启发,本文试图对与空间插值相关的真实预测误差进行形式化。我们调查了各种交叉验证(CV)程序采用模拟和案例研究,以提供洞察替代数据分区策略的估计目标的性质。与最近的最佳实践相一致,我们发现基于位置的交叉验证适合于估计空间插值误差,如我们对加利福尼亚野火数据的分析。有趣的是,通常持有的CV折叠大小的偏差-方差权衡的概念并不平凡地适用于相关数据,我们建议留一位置(LOLO)CV作为空间插值的首选预测误差度量。
英文摘要:
Evaluation metrics for prediction error, model selection and model averaging on space-time data are understudied and poorly understood. The absence of independent replication makes prediction ambiguous as a concept and renders evaluation procedures developed for independent data inappropriate for most space-time prediction problems. Motivated by air pollution data collected during California wildfires in 2008, this manuscript attempts a formalization of the true prediction error associated with spatial interpolation. We investigate a variety of cross-validation (CV) procedures employing both simulations and case studies to provide insight into the nature of the estimand targeted by alternative data partition strategies. Consistent with recent best practice, we find that location-based cross-validation is appropriate for estimating spatial interpolation error as in our analysis of the California wildfire data. Interestingly, commonly held notions of bias-variance trade-off of CV fold size do not trivially apply to dependent data, and we recommend leave-one-location-out (LOLO) CV as the preferred prediction error metric for spatial interpolation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。