MultiCast:使用大语言模型进行零样本多变量时间序列预测
MultiCast: Zero-Shot Multivariate Time Series Forecasting Using LLMs
AI总结:
MultiCast提出一种基于大语言模型的零样本多变量时间序列预测方法,通过令牌复用和量化方案降低维度并保留模式,在三个数据集上优于现有方法。
摘要:
在多变量时间序列中预测未来值在多个领域至关重要。本研究探索了使用大语言模型(LLMs)来完成此任务。然而,LLMs通常处理一维数据。我们引入了MultiCast,一种基于LLM的零样本多变量时间序列预测方法。它通过三种新颖的令牌复用解决方案使LLMs能够接收多变量时间序列作为输入,这些方案有效降低了维度,同时保留了关键的重复模式。此外,一种量化方案帮助LLMs更好地学习这些模式,同时显著减少实际应用中的令牌使用。我们在三个真实世界数据集上,以RMSE和执行时间为指标,展示了我们的方法相对于最先进方法的性能。
英文摘要:
Predicting future values in multivariate time series is vital across various domains. This work explores the use of large language models (LLMs) for this task. However, LLMs typically handle one-dimensional data. We introduce MultiCast, a zero-shot LLM-based approach for multivariate time series forecasting. It allows LLMs to receive multivariate time series as input, through three novel token multiplexing solutions that effectively reduce dimensionality while preserving key repetitive patterns. Additionally, a quantization scheme helps LLMs to better learn these patterns, while significantly reducing token use for practical applications. We showcase the performance of our approach in terms of RMSE and execution time against state-of-the-art approaches on three real-world datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。