Although the rise of large language models (LLMs) has introduced new opportunities for time series forecasting, existing LLM-based solutions require excessive training and exhibit limited transferability. In view of these challenges, we propose TimeRAG, a framework that incorporates Retrieval-Augmented Generation (RAG) into time series forecasting LLMs, which constructs a time series knowledge base from historical sequences, retrieves reference sequences from the knowledge base that exhibit similar patterns to the query sequence measured by Dynamic Time Warping (DTW), and combines these reference sequences and the prediction query as a textual prompt to the time series forecasting LLM. Experiments on datasets from various domains show that the integration of RAG improved the prediction accuracy of the original model by 2.97% on average.
PeriodNet: Boosting the Potential of Attention Mechanism for Time Series Forecasting
School of Computing and Artificial Intelligence, Southwest Jiaotong University(计算机与人工智能学院,西南交通大学);Tangshan Institute of Southwest Jiaotong University(西南交通大学唐山研究院);School of Computer Science, University of Nottingham(计算机科学学院,诺丁汉大学);School of Mathematics and Statistics, Xi’an Jiaotong University(数学与统计学院,西安交通大学)
KDD CUP 2022 Wind Power Forecasting Team 88VIP Solution
Alibaba Group(阿里巴巴集团)
KDD CUP 2022提出了一个空间动态风电数据集的时间序列预测任务,要求参与者在给定历史背景因素的情况下预测未来的发电量。评估指标包括RMSE和MAE。本文描述了Team 88 VIP的解决方案,该方案主要包括两种模型:用于记忆基本数据模式的梯度提升决策树和用于捕获深层和潜在概率转移的递归神经网络。集成这些模型有助于解决风电功率的波动问题,训练子模型的目标是在从几分钟到几天的不同时间尺度的预测中的突出特性。此外,还详细介绍了特征工程、插补技术和离线评价的设计。所提出的解决方案在阶段3中实现了-45.213的总体在线分数。
Disentangling Long-Short Term State Under Unknown Interventions for Online Time Series Forecasting
School of Computer Science, Guangdong University of Technology(广东工业大学计算机学院);Peng Cheng Laboratory(鹏城实验室);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Shantou University(汕头大学)