XLinear:基于交叉过滤的频率增强MLP用于鲁棒长程预测
XLinear: Frequency-Enhanced MLP with CrossFilter for Robust Long-Range Forecasting
AI总结:
本文提出XLinear,通过频率增强注意力和交叉过滤模块,提升MLP在长程预测中的鲁棒性和依赖捕捉能力。
摘要:
时间序列预测器被广泛应用于各个领域。其中,基于多层感知机(MLP)的预测器已被证明比基于Transformer的预测器更具噪声鲁棒性。然而,MLP在捕捉复杂特征方面存在困难,导致在捕捉长程依赖方面存在限制。为了解决这一挑战,我们提出了XLinear,一种用于长程预测的基于MLP的预测器。首先,我们将时间序列分解为趋势和季节性成分。对于包含长程特征的趋势成分,我们设计了增强频率注意力(EFA),通过利用频域操作来捕捉长期依赖性。此外,还提出了CrossFilter模块用于季节性成分,以保持模型对噪声的鲁棒性,避免由注意力机制引起的低鲁棒性问题。实验结果表明,XLinear在测试数据集上实现了最先进的性能。尽管保持了MLP模型的轻量架构和高鲁棒性,我们的预测器在捕捉长程依赖方面优于其他基于MLP的预测器。
英文摘要:
Time series forecasters are widely used across various domains. Among them, MLP (multi-layer perceptron)-based forecasters have been proven to be more robust to noise compared to Transformer-based forecasters. However, MLP struggles to capture complex features, resulting in limitations on capturing long-range dependencies. To address this challenge, we propose XLinear, an MLP-based forecaster for long-range forecasting. Firstly, we decompose the time series into trend and seasonal components. For the trend component which contains long-range characteristics, we design Enhanced Frequency Attention (EFA) to capture long-term dependencies by leveraging frequency-domain operations. Additionally, a CrossFilter Block is proposed for the seasonal component to maintain the model's robustness to noise, avoiding the problems of low robustness often caused by attention mechanisms. Experimental results demonstrate that XLinear achieves state-of-the-art performance on test datasets. While keeping the lightweight architecture and high robustness of MLP-based models, our forecaster outperforms other MLP-based forecasters in capturing long-range dependencies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。