arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.10835cs.CL
收藏

基于大语言模型的时间序列预测:理解与增强模型能力

Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities

Rutgers University(罗格斯大学);Shanghai Jiaotong University(上海交通大学);University of Liverpool(利物浦大学);New Jersey Institute of Technology(新泽西理工学院);Xi’an Jiaotong-Liverpool University(西交利物浦大学)

Hua Tang, Chong Zhang, Mingyu Jin, Qinkai Yu, Zhenting Wang, Xiaobo Jin, Yongfeng Zhang, Mengnan Du

AI总结:

本文通过与传统模型对比,系统研究大语言模型在零样本时间序列预测中的能力与局限,发现其对周期性数据表现更优,并证明引入外部知识和自然语言改写可显著提升预测性能。

摘要:

大语言模型(LLMs)近年来已在许多领域得到应用并迅速发展。作为经典的机器学习任务,时间序列预测最近也因大语言模型而得到显著推动。近期工作将大语言模型视为零样本时间序列推理器,无需进一步微调即可取得显著性能。然而,在零样本设定下将大语言模型用于时间序列预测时,仍存在一些尚未探索的研究问题。例如,大语言模型对输入时间序列的偏好尚不为人所充分理解。本文通过将大语言模型与传统时间序列预测模型进行比较,观察到大语言模型在时间序列预测语境下的许多有趣特性。首先,我们的研究表明,大语言模型在预测具有清晰模式和趋势的时间序列时表现良好,但在缺乏周期性的数据集上则面临挑战。这一观察可由大语言模型识别数据集中潜在周期的能力来解释,并得到我们实验的支持。此外,我们还研究了输入策略,发现引入外部知识并采用自然语言改写能够显著提升大语言模型在时间序列预测上的性能。总体而言,我们的研究有助于深入理解大语言模型在不同条件下进行时间序列预测时的优势与局限。

英文摘要:

Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. As a classic machine learning task, time series forecasting has recently been boosted by LLMs. Recent works treat large language models as \emph{zero-shot} time series reasoners without further fine-tuning, which achieves remarkable performance. However, there are some unexplored research problems when applying LLMs for time series forecasting under the zero-shot setting. For instance, the LLMs' preferences for the input time series are less understood. In this paper, by comparing LLMs with traditional time series forecasting models, we observe many interesting properties of LLMs in the context of time series forecasting. First, our study shows that LLMs perform well in predicting time series with clear patterns and trends, but face challenges with datasets lacking periodicity. This observation can be explained by the ability of LLMs to recognize the underlying period within datasets, which is supported by our experiments. In addition, the input strategy is investigated, and it is found that incorporating external knowledge and adopting natural language paraphrases substantially improve the predictive performance of LLMs for time series. Overall, our study contributes insight into LLMs' advantages and limitations in time series forecasting under different conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑