arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2603.26017cs.LG
收藏

QuitoBench: 一个高质量的开放时间序列预测基准

QuitoBench: A High-Quality Open Time Series Forecasting Benchmark

Ant Group(蚂蚁集团)

Siqiao Xue, Zhaoyang Zhu, Wei Zhang, Rongyao Cai, Rui Wang, Yixiang Mu, Fan Zhou, Jianguo Li, Peng Di, Hang Yu

AI总结:

QuitoBench通过构建覆盖八个TSF领域的高质量时间序列基准,揭示了深度学习模型在短上下文中的优势、预测难度对性能的影响以及数据量扩展对模型效果的提升作用。

摘要:

时间序列预测在金融、医疗和云计算领域至关重要,但进展受限于大规模高质量基准的缺乏。为解决这一问题,我们引入QuitoBench,一个平衡不同趋势、季节性和预测性(TSF)领域的基准,基于Alipay的九个业务领域中的十亿级时间序列语料库构建。在232,200个评估实例上测试了10种深度学习、基础模型和统计基线模型,发现四个关键结论:(i) 上下文长度临界点,深度学习模型在短上下文(L=96)占优,而基础模型在长上下文(L≥576)占优;(ii) 预测性是主要难度驱动因素,导致不同领域间MAE差距达3.64倍;(iii) 深度学习模型在参数仅为基础模型1/59的情况下表现相当或更优;(iv) 增加训练数据量比增加模型规模对两种模型家族的提升更显著。这些发现通过跨基准和跨指标的一致性得到验证。我们的开源发布使时间序列预测研究能够进行可重复、领域感知的评估。

英文摘要:

Time series forecasting is critical across finance, healthcare, and cloud computing, yet progress is constrained by a fundamental bottleneck: the scarcity of large-scale, high-quality benchmarks. To address this gap, we introduce \textsc{QuitoBench}, a regime-balanced benchmark for time series forecasting with coverage across eight trend$\times$seasonality$\times$forecastability (TSF) regimes, designed to capture forecasting-relevant properties rather than application-defined domain labels. The benchmark is built upon \textsc{Quito}, a billion-scale time series corpus of application traffic from Alipay spanning nine business domains. Benchmarking 10 models from deep learning, foundation models, and statistical baselines across 232,200 evaluation instances, we report four key findings: (i) a context-length crossover where deep learning models lead at short context ($L=96$) but foundation models dominate at long context ($L \ge 576$); (ii) forecastability is the dominant difficulty driver, producing a $3.64 \times$ MAE gap across regimes; (iii) deep learning models match or surpass foundation models at $59 \times$ fewer parameters; and (iv) scaling the amount of training data provides substantially greater benefit than scaling model size for both model families. These findings are validated by strong cross-benchmark and cross-metric consistency. Our open-source release enables reproducible, regime-aware evaluation for time series forecasting research.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑