arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.03182cs.LG
收藏

赋能时间序列分析的大语言模型:综述

Empowering Time Series Analysis with Large Language Models: A Survey

School of Computing, University of Connecticut(康涅狄格大学计算机学院);School of Computer Science, The University of Sydney(悉尼大学计算机学院);Department of Machine Learning Research, Morgan Stanley(摩根士丹利机器学习研究部)

Yushan Jiang, Zijie Pan, Xikun Zhang, Sahil Garg, Anderson Schneider, Yuriy Nevmyvaka, Dongjin Song

AI总结:

本综述系统梳理了利用大语言模型进行时间序列分析的方法,涵盖挑战、流程分类及应用,并展望未来研究方向。

摘要:

近年来,大语言模型(LLMs)取得了显著进展,展示了其在各种自然语言任务中前所未有的能力。然而,由于时间序列数据量大、种类繁多,以及非平稳性导致的概念漂移阻碍了模型的持续适应和再训练,从头完全训练一个通用大模型对于时间序列分析而言具有挑战性。最近的进展表明,预训练的LLMs可以被利用来捕获时间序列数据中的复杂依赖关系,并促进各种应用。在本综述中,我们系统地概述了利用LLMs进行时间序列分析的现有方法。具体来说,我们首先阐述了在时间序列背景下应用语言模型的挑战和动机,以及LLMs的简要预备知识。接下来,我们总结了基于LLM的时间序列分析的通用流程,将现有方法分为不同类别(即直接查询、分词、提示设计、微调和模型集成),并强调了每个类别中的关键思想。我们还讨论了LLMs在通用和时空时间序列数据上的应用,这些应用针对特定领域进行了定制。最后,我们深入讨论了未来利用LLMs赋能时间序列分析的研究机会。

英文摘要:

Recently, remarkable progress has been made over large language models (LLMs), demonstrating their unprecedented capability in varieties of natural language tasks. However, completely training a large general-purpose model from the scratch is challenging for time series analysis, due to the large volumes and varieties of time series data, as well as the non-stationarity that leads to concept drift impeding continuous model adaptation and re-training. Recent advances have shown that pre-trained LLMs can be exploited to capture complex dependencies in time series data and facilitate various applications. In this survey, we provide a systematic overview of existing methods that leverage LLMs for time series analysis. Specifically, we first state the challenges and motivations of applying language models in the context of time series as well as brief preliminaries of LLMs. Next, we summarize the general pipeline for LLM-based time series analysis, categorize existing methods into different groups (i.e., direct query, tokenization, prompt design, fine-tune, and model integration), and highlight the key ideas within each group. We also discuss the applications of LLMs for both general and spatial-temporal time series data, tailored to specific domains. Finally, we thoroughly discuss future research opportunities to empower time series analysis with LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑