Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities
Rutgers University(罗格斯大学);Shanghai Jiaotong University(上海交通大学);University of Liverpool(利物浦大学);New Jersey Institute of Technology(新泽西理工学院);Xi’an Jiaotong-Liverpool University(西交利物浦大学)
Large language models (LLMs) have been applied in many fields and have developed rapidly in recent years. As a classic machine learning task, time series forecasting has recently been boosted by LLMs. Recent works treat large language models as \emph{zero-shot} time series reasoners without further fine-tuning, which achieves remarkable performance. However, there are some unexplored research problems when applying LLMs for time series forecasting under the zero-shot setting. For instance, the LLMs' preferences for the input time series are less understood. In this paper, by comparing LLMs with traditional time series forecasting models, we observe many interesting properties of LLMs in the context of time series forecasting. First, our study shows that LLMs perform well in predicting time series with clear patterns and trends, but face challenges with datasets lacking periodicity. This observation can be explained by the ability of LLMs to recognize the underlying period within datasets, which is supported by our experiments. In addition, the input strategy is investigated, and it is found that incorporating external knowledge and adopting natural language paraphrases substantially improve the predictive performance of LLMs for time series. Overall, our study contributes insight into LLMs' advantages and limitations in time series forecasting under different conditions.
ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilities
Forecasting Research Institute(预测研究所);Federal Reserve Bank of Chicago(芝加哥联邦储备银行);New York University(纽约大学);University of California, Berkeley(加州大学伯克利分校);University of Pennsylvania(宾夕法尼亚大学)
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR))
EstLLM: Enhancing Estonian Capabilities in Multilingual LLMs via Continued Pretraining and Post-Training
Institute of Computer Science, University of Tartu(塔尔图大学计算机科学研究院);Department of Software Science, Tallinn University of Technology(塔林技术大学软件科学系);Institute of the Estonian Language, Tallinn, Estonia(爱沙尼亚语言研究院);School of Humanities, Tallinn University(塔林大学人文学院)
Context-Alignment: Activating and Enhancing LLM Capabilities in Time Series
The Hong Kong Polytechnic University(香港理工大学);Ningbo Institute of Digital Twin(宁波数字孪生研究所);Eastern Institute of Technology(东部技术研究所);Shanghai Jiao Tong University(上海交通大学)
CivWorldBench: Evaluating Language World Models in Structured Multi-Agent Sandbox Worlds
The Chinese University of Hong Kong(香港中文大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);UniPat AI;Peking University(北京大学);TME(腾讯音乐娱乐集团);The Hong Kong University of Science and Technology(香港科技大学)