空间结构化数据模型的空间交叉验证方法的性能评估
Assessing the performance of spatial cross-validation approaches for models of spatially structured data
摘要:
评估模型是否适合具有内部空间结构的数据需要特定的交叉验证(CV)方法,因为随机选择评估数据可能会产生并非真正独立于用于训练模型的数据的评估集。已经提出了许多空间CV方法,通过在预测评估集时强制模型进行空间外推来解决这一问题。然而,到目前为止,几乎没有指导哪些方法产生最准确的估计模型的性能。我们进行了模拟,比较模型的性能估计五个常见的CV方法适合空间结构化的数据。我们发现,空间CV方法通常在重新替换和V倍CV估计后得到改善,特别是当将空间联合观测的评估集与空间排除缓冲区相结合时。为了便于使用这些技术,我们引入了`spatialsample`包,它提供了执行空间CV的工具,作为更广泛的tidymodels建模框架的一部分。
英文摘要:
Evaluating models fit to data with internal spatial structure requires specific cross-validation (CV) approaches, because randomly selecting assessment data may produce assessment sets that are not truly independent of data used to train the model. Many spatial CV methodologies have been proposed to address this by forcing models to extrapolate spatially when predicting the assessment set. However, to date there exists little guidance on which methods yield the most accurate estimates of model performance. We conducted simulations to compare model performance estimates produced by five common CV methods fit to spatially structured data. We found spatial CV approaches generally improved upon resubstitution and V-fold CV estimates, particularly when approaches which combined assessment sets of spatially conjunct observations with spatial exclusion buffers. To facilitate use of these techniques, we introduce the `spatialsample` package which provides tooling for performing spatial CV as part of the broader tidymodels modeling framework.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。