全局树模型在层级聚合处崩溃：五面板失败特征刻画
Global tree forecasters collapse at the hierarchical aggregate: a five-panel failure characterization
浏览论文内容
中文总结 AI 辅助
本研究揭示全局树模型在预测层级聚合值时因超出训练范围而崩溃，低估总量达30-496倍，并提出按序列缩放、加权聚合行和季节性差分等预防方法及三步诊断程序。
中文摘要 AI 辅助
全局预测模型将多个序列汇集在一起，学习一个共享函数。梯度提升树是它们最常见的形式。我们测量了这一设计的一个此前（据我们所知）未被记录的失败。在层级结构的各个单独序列上训练一个全局树模型，然后要求它预测层级聚合值。该聚合值远在模型的训练范围之外，预测随即崩溃。在我们的生产部署中，模型对总量的低估达30-50倍，在公开的M5重建中则高达496倍。其机制是已知的：超出训练范围后，树模型预测一个常数。该问题在聚合层面显现，因为总量远超任何训练序列。解决方案并非新事物。按序列缩放这一预处理步骤（Montero-Manso和Hyndman，2021年推荐）可防止崩溃。加权聚合级训练行和季节性差分同样有效。我们的贡献在于特征刻画。该崩溃在五个面板上重现：一个生产型B2B市场、一个合成层级、M5、澳大利亚旅游数据，以及一个公开的企业买家面板。它在三个树库上成立，对训练种子不变，且具有统计显著性。其发生是即时的，并遵循一个简单的支持界：仅1.15倍的尺度差距就已造成总量的三分之一损失。没有标准配置更改能防止它：将所有层级级别汇入训练在规模上失败，而让线性模型拟合叶节点的那个旋钮只能缓解而不能治愈。递归滚动预测向前区分了各种疗法：聚合行疗法重新崩溃，按序列缩放会退化但保持较低水平，只有季节性差分能保持其一阶精度不变。我们以一套三步程序作为结尾，用于在部署系统中诊断和防止该失败。
英文摘要
Global forecasting models pool many series and learn one shared function. Gradient-boosted trees are their most common form. We measure a failure of this design that has not, to our knowledge, been documented. Train a global tree on the individual series of a hierarchy, then ask it for the hierarchical aggregate. The aggregate sits far outside the model's training range, and the forecast collapses. The model under-predicts the total by 30-50x in our production deployment, and by up to 496x in a public M5 reconstruction. The mechanism is known: beyond its training range, a tree predicts a constant. It surfaces at the aggregate because the total dwarfs every training series. The cure is not new. Per-series scaling, the preprocessing step that Montero-Manso and Hyndman (2021) recommend, prevents the collapse. So do a weighted aggregate-level training row and seasonal differencing. Our contribution is the characterization. The collapse reproduces on five panels: a production business-to-business marketplace, a synthetic hierarchy, M5, Australian Tourism, and a public business-buyer panel. It holds on three tree libraries, is invariant across training seeds, and is statistically significant. Its onset is immediate and tracks a simple support bound: a scale gap of only 1.15x already costs a third of the total. No standard configuration change prevents it: pooling every hierarchy level into training fails at scale, and the one knob that fits linear models in the leaves softens it without curing it. Rolling the forecasts forward recursively separates the cures: the aggregate-row cure re-collapses, per-series scaling degrades but stays low, and only seasonal differencing keeps its one-step accuracy unchanged. We close with a three-step procedure for diagnosing and preventing the failure in deployed systems.
发表机构
- Field Nation LLC（Field Nation 有限责任公司）
机构由 AI 辅助整理，请以论文原文为准。
