arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.19065cs.LGcs.AI
收藏

BEAT:面向长期时间序列预测的平衡频率自适应调优

BEAT: Balanced Frequency Adaptive Tuning for Long-Term Time-Series Forecasting

Zhixuan Li, Naipeng Chen, Seonghwa Choi, Sanghoon Lee, Weisi Lin

AI总结:

针对频域时间序列预测中高频过拟合与低频欠拟合的问题,提出BEAT框架,通过动态监控各频率训练状态并自适应调整梯度更新,在七个真实数据集上超越现有方法。

摘要:

时间序列预测对于包括天气预报和金融市场建模在内的众多实际应用至关重要。虽然时域方法仍然普遍,但频域方法能够有效捕获多尺度周期模式,减少序列依赖性,并自然地实现信号去噪。然而,现有方法通常在统一训练目标下训练所有频率的模型组件,这常常导致学习速度不匹配:高频分量收敛更快并有过拟合风险,而低频分量因训练时间不足而欠拟合。为应对这一挑战,我们提出BEAT(平衡频率自适应调优),一种新颖框架,它动态监控每个频率的训练状态并自适应调整其梯度更新。通过识别每个频率的收敛、过拟合或欠拟合状态,BEAT动态重新分配学习优先级,对快速学习者缓和梯度,对较慢学习者增加梯度,从而缓解跨频率竞争目标之间的张力,并同步整体学习过程。在七个真实世界数据集上的大量实验表明,BEAT始终优于最先进的方法。

英文摘要:

Long-term time-series forecasting supports a wide range of applications, including weather prediction and electricity demand planning. Frequency-domain methods address this task by decomposing observations into components that describe temporal variations at different scales. However, separate representations do not by themselves provide an explicit mechanism for adjusting the training emphasis across components. Under a shared forecasting objective, the frequency-specific networks can retain different levels of coefficient prediction error, motivating an error-dependent adjustment to their gradients. To this end, we propose BEAT (Balanced frEquency Adaptive Tuning), a framework that combines frequency-specific error monitoring with adaptive gradient modulation. We design a Frequency-Specific Monitor that compares predicted and target wavelet coefficients in a common normalized space and expresses each discrepancy relative to a reference error computed from the detail components. We further introduce a Dynamical Gradient Balancer that converts these ratios into positive, bounded coefficients. Components with higher relative errors receive larger gradient weights, whereas those with lower relative errors receive smaller weights. A shared modulation-strength parameter controls the departure from unmodulated training, and the monitoring and balancing operations are used only during training. Experiments on seven real-world datasets show that BEAT achieves competitive performance against state-of-the-art forecasting methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑