Large Language Models (LLMs) have seen significant use in domains such as natural language processing and computer vision. Going beyond text, image and graphics, LLMs present a significant potential for analysis of time series data, benefiting domains such as climate, IoT, healthcare, traffic, audio and finance. This survey paper provides an in-depth exploration and a detailed taxonomy of the various methodologies employed to harness the power of LLMs for time series analysis. We address the inherent challenge of bridging the gap between LLMs' original text data training and the numerical nature of time series data, and explore strategies for transferring and distilling knowledge from LLMs to numerical time series analysis. We detail various methodologies, including (1) direct prompting of LLMs, (2) time series quantization, (3) aligning techniques, (4) utilization of the vision modality as a bridging mechanism, and (5) the combination of LLMs with tools. Additionally, this survey offers a comprehensive overview of the existing multimodal time series and text datasets and delves into the challenges and future opportunities of this emerging field. We maintain an up-to-date Github repository which includes all the papers and datasets discussed in the survey.
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey
Raytheon BBN Technologies(雷神BBN技术公司);Harvard University(哈佛大学);University of Pennsylvania(宾夕法尼亚大学);University of Oregon(俄勒冈大学);University of the Basque Country (UPV/EHU)(巴斯克大学 (UPV/EHU))
The language of time: a language model perspective on time-series foundation models
College of Computer Science and Artificial Intelligence, Fudan University(计算机科学与人工智能学院,复旦大学);Shanghai Key Laboratory of Data Science(上海数据科学重点实验室);ZCTech;School of Mathematics and Statistics, Beijing Institute of Technology(数学与统计学学院,北京理工大学)
Harnessing Vision Models for Time Series Analysis: A Survey
University of Houston(德克萨斯大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Connecticut(康涅狄格大学);NEC Laboratories America(日本 NEC 美国实验室);Florida International University(佛罗里达国际大学)
From Time Series Analysis to Question Answering: A Survey in the LLM Era
Renmin University of China(中国人民大学);Tsinghua University(清华大学);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Aalborg University(奥胡斯大学)
Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook
Griffith University(格里菲斯大学);University of Oxford(牛津大学);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Zhejiang Normal University(浙江师范大学);Ant Group(蚂蚁集团);Alibaba Group(阿里巴巴集团);Deloitte Service LLP(德勤服务有限责任公司);The University of Hong Kong(香港大学);NEC Laboratories America(NEC美国实验室);A*STAR;National Yang Ming Chiao Tung University(阳明交通大学);JD Technology(京东科技);Squirrel Ai Learning
LAMPER: LanguAge Model and Prompt EngineeRing for zero-shot time series classification
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学清华大学深圳国际研究生院);School of Automation, Wuhan University of Technology(武汉理工大学自动化学院)
From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models
School of Computer Science, Sichuan University(四川大学计算机学院);School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School(北京大学深圳研究生院电子与计算机工程学院);Institute of Artificial Intelligence (TeleAI), China Telecom and Northwestern Polytechnical University(中国电信与西北工业大学人工智能研究院(TeleAI))
Survey Response Generation: Generating Closed-Ended Survey Responses In-Silico with Large Language Models
University of Mannheim(曼海姆大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning(慕尼黑机器学习中心);University of Maryland, College Park(马里兰大学学院公园分校);GESIS Cologne(科隆社会研究所);CSH Vienna(维也纳认知科学研究所)
Natural Language Processing for Dialects of a Language: A Survey
University of New South Wales(新南威尔士大学);National Institute of Information and Communications Technology(信息通信技术研究所);University of Surrey(萨里大学);Monash University(莫纳什大学)
Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Shanghai University of Finance and Economics(上海财经大学)