arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.03399cs.LGcs.AI
收藏

RHiOTS:一个用于评估分层时间序列预测算法的框架

RHiOTS: A Framework for Evaluating Hierarchical Time Series Forecasting Algorithms

LIACC/Faculty of Engineering, University of Porto(波尔图大学工程学院/LIACC);Fraunhofer AICOS Portugal(弗劳恩霍夫AICOS葡萄牙分部);Dalhousie University(达尔豪斯大学)

Luis Roque, Carlos Soares, Luís Torgo

AI总结:

本文提出RHiOTS框架,通过可参数化变换和可视化组件系统评估分层时间序列预测算法的鲁棒性,发现传统统计方法总体上比深度学习算法更鲁棒,且MinT等协调方法对算法鲁棒性无显著影响。

摘要:

我们引入了分层组织时间序列鲁棒性(RHiOTS)框架,旨在评估分层时间序列预测模型和算法在真实世界数据集上的鲁棒性。分层时间序列要求较低层级的预测值必须汇总到较高层级,这类序列在各种场景中普遍存在,例如跨国家的零售销售。当前对预测方法的实证评估往往局限于少量基准数据集,只能提供对算法行为的狭窄视角。RHiOTS通过系统地改变现有数据集并修改单个序列的特征及其相互关系来弥补这一不足。它使用一组可参数化的变换来模拟数据分布中的这些变化。此外,RHiOTS还包含一个创新的可视化组件,将复杂的多维鲁棒性评估结果转化为直观、易于解释的图形。这种方法允许在不同条件下深入分析算法和模型的行为。我们通过分析若干算法的预测性能来说明RHiOTS的使用。我们的研究结果表明,传统统计方法比最先进的深度学习算法更具鲁棒性,除非变换效应具有高度破坏性。此外,我们发现当应用特定的协调方法(如MinT)时,各算法的鲁棒性没有显著差异。RHiOTS为研究人员提供了一个全面的工具,用于理解预测算法的细微行为,为针对给定问题选择最合适的方法提供了更可靠的基础。

英文摘要:

We introduce the Robustness of Hierarchically Organized Time Series (RHiOTS) framework, designed to assess the robustness of hierarchical time series forecasting models and algorithms on real-world datasets. Hierarchical time series, where lower-level forecasts must sum to upper-level ones, are prevalent in various contexts, such as retail sales across countries. Current empirical evaluations of forecasting methods are often limited to a small set of benchmark datasets, offering a narrow view of algorithm behavior. RHiOTS addresses this gap by systematically altering existing datasets and modifying the characteristics of individual series and their interrelations. It uses a set of parameterizable transformations to simulate those changes in the data distribution. Additionally, RHiOTS incorporates an innovative visualization component, turning complex, multidimensional robustness evaluation results into intuitive, easily interpretable visuals. This approach allows an in-depth analysis of algorithm and model behavior under diverse conditions. We illustrate the use of RHiOTS by analyzing the predictive performance of several algorithms. Our findings show that traditional statistical methods are more robust than state-of-the-art deep learning algorithms, except when the transformation effect is highly disruptive. Furthermore, we found no significant differences in the robustness of the algorithms when applying specific reconciliation methods, such as MinT. RHiOTS provides researchers with a comprehensive tool for understanding the nuanced behavior of forecasting algorithms, offering a more reliable basis for selecting the most appropriate method for a given problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑