Empowering Time Series Analysis with Large Language Models: A Survey
School of Computing, University of Connecticut(康涅狄格大学计算机学院);School of Computer Science, The University of Sydney(悉尼大学计算机学院);Department of Machine Learning Research, Morgan Stanley(摩根士丹利机器学习研究部)
Yushan Jiang, Zijie Pan, Xikun Zhang, Sahil Garg, Anderson Schneider, Yuriy Nevmyvaka, Dongjin Song
Recently, remarkable progress has been made over large language models (LLMs), demonstrating their unprecedented capability in varieties of natural language tasks. However, completely training a large general-purpose model from the scratch is challenging for time series analysis, due to the large volumes and varieties of time series data, as well as the non-stationarity that leads to concept drift impeding continuous model adaptation and re-training. Recent advances have shown that pre-trained LLMs can be exploited to capture complex dependencies in time series data and facilitate various applications. In this survey, we provide a systematic overview of existing methods that leverage LLMs for time series analysis. Specifically, we first state the challenges and motivations of applying language models in the context of time series as well as brief preliminaries of LLMs. Next, we summarize the general pipeline for LLM-based time series analysis, categorize existing methods into different groups (i.e., direct query, tokenization, prompt design, fine-tune, and model integration), and highlight the key ideas within each group. We also discuss the applications of LLMs for both general and spatial-temporal time series data, tailored to specific domains. Finally, we thoroughly discuss future research opportunities to empower time series analysis with LLMs.
Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models
Salesforce AI Research(Salesforce AI研究院);National University of Singapore(新加坡国立大学);Squirrel Ai Learning(松鼠人工智能学习);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
LLM-PS: Empowering Large Language Models for Time Series Forecasting with Temporal Patterns and Semantics
Nanjing University of Science and Technology(南京理工大学);Nanjing University(南京大学);Shanghai Jiao Tong University(上海交通大学);Wuhan University(武汉大学);Nanyang Technological University(南洋理工大学)
Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Shanghai University of Finance and Economics(上海财经大学)
Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Experts
Salesforce AI Research(Salesforce AI研究院);National University of Singapore(新加坡国立大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning
Sun Yat-sen University(中山大学);Xiaomi Corporation(小米公司);University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学)
Intelligently Augmented Contrastive Tensor Factorization: Empowering Multi-dimensional Time Series Classification in Low-Data Environments
Engineering Product Development Singapore University of Technology and Design(新加坡科技与设计大学工程产品开发学院);School of Automation Chongqing University(重庆大学自动化学院);Institute for Infocomm Research Agency for Science, Technology and Research(信息与通信研究所);School of Electrical and Electronics Engineering Nanyang Technological University(南洋理工大学电子与电气工程学院)
Foundation Models for Time Series Analysis: A Tutorial and Survey
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing Jiao Tong University(北京交通大学);HKUST(GZ)(香港科技大学(广州));Princeton University(普林斯顿大学);University of Connecticut(康涅狄格大学);Monash University(莫纳什大学);Griffith University(格里菲斯大学);Squirrel AI(松鼠AI)
PaAno+: Multiscale Encoding and Cross-Variable Attention for Time Series Anomaly Detection
School of Mathematical Sciences, Guizhou Normal University(贵州师范大学数学科学学院);School of Big Data and Computer Science, Guizhou Normal University(贵州师范大学大数据与计算机科学学院)
A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly Detection
Griffith University(格里菲斯大学);Monash University(莫纳什大学);Squirrel AI(松鼠AI);IDSIA(瑞士IDSIA人工智能实验室);Università della Svizzera italiana(意大利语瑞士大学);Politecnico di Milano(米兰理工大学);The Chinese University of Hong Kong(香港中文大学)
Deep Learning for Multivariate Time Series Imputation: A Survey
PyPOTS Research(PyPOTS研究机构);Hong Kong University of Science and Technology(香港理工大学);University of Oxford(牛津大学);King’s College London(伦敦大学学院);Huawei Noah’s Ark Lab(华为诺亚实验室);Hong Kong University of Science and Technology (Guangzhou)(香港理工大学(广州));Squirrel Ai Learning(Squirrel Ai学习机构)
Generative adversarial networks in time series: A survey and taxonomy
Infant Research Centre(婴儿研究中心);School of Computing(计算学院);Dublin City University(都柏林城市大学);ByteDance AI Lab(字节跳动人工智能实验室);Insight SFI Research Centre for Data Analytics(Insight SFI数据分析研究中心)
From Deep Learning to LLMs: A survey of AI in Quantitative Investment
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));IDEA Research, International Digital Economy Academy(国际数字经济学院IDEA研究院);The Hong Kong University of Science and Technology(香港科技大学)
Harnessing Vision Models for Time Series Analysis: A Survey
University of Houston(德克萨斯大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Connecticut(康涅狄格大学);NEC Laboratories America(日本 NEC 美国实验室);Florida International University(佛罗里达国际大学)
Out-of-Distribution Generalization in Time Series: A Survey
School of Computing and Artificial Intelligence, Southwest Jiaotong University(计算机与人工智能学院,西南交通大学);Engineering Research Center of Sustainable Urban Intelligent Transportation, Ministry of Education(可持续城市智能交通工程研究中心,教育部);Information Sciences and Technology Department, the Pennsylvania State University(信息科学与技术系,宾夕法尼亚州立大学)