arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.14735cs.LG
收藏

面向时间序列分析的基础模型:教程与综述

Foundation Models for Time Series Analysis: A Tutorial and Survey

The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Beijing Jiao Tong University(北京交通大学);HKUST(GZ)(香港科技大学(广州));Princeton University(普林斯顿大学);University of Connecticut(康涅狄格大学);Monash University(莫纳什大学);Griffith University(格里菲斯大学);Squirrel AI(松鼠AI)

Yuxuan Liang, Haomin Wen, Yuqi Nie, Yushan Jiang, Ming Jin, Dongjin Song, Shirui Pan, Qingsong Wen

AI总结:

该综述针对现有时间序列基础模型研究多聚焦应用或流程、缺乏内在机制阐释的不足,以方法论为核心分类梳理其架构、预训练等关键要素,系统整合相关进展并指明未来方向。

摘要:

时间序列分析是数据挖掘领域的核心研究方向,是提取有价值洞见的基石,这些洞见对众多实际应用至关重要。基础模型(Foundation Models, FMs)的最新进展从根本上重塑了时间序列分析的模型设计范式,在实践中推动了各类下游任务的发展。这类创新方法通常利用预训练或微调后的FMs,获取适配时间序列分析的通用知识。本综述旨在全面且最新地梳理面向时间序列分析的FMs研究。以往的综述大多聚焦于FMs在时间序列分析中的应用或流程层面,往往未能深入理解FMs为何以及如何赋能时间序列分析的内在机制。为填补这一空白,本综述采用以方法论为核心的分类方式,详细阐述时间序列FMs的各类关键要素,包括模型架构、预训练技术、适配方法以及数据模态。总体而言,本综述整合了与时间序列分析相关的FMs最新进展,着重强调其理论基础、近期发展成果以及未来探索方向。

英文摘要:

Time series analysis stands as a focal point within the data mining community, serving as a cornerstone for extracting valuable insights crucial to a myriad of real-world applications. Recent advances in Foundation Models (FMs) have fundamentally reshaped the paradigm of model design for time series analysis, boosting various downstream tasks in practice. These innovative approaches often leverage pre-trained or fine-tuned FMs to harness generalized knowledge tailored for time series analysis. This survey aims to furnish a comprehensive and up-to-date overview of FMs for time series analysis. While prior surveys have predominantly focused on either application or pipeline aspects of FMs in time series analysis, they have often lacked an in-depth understanding of the underlying mechanisms that elucidate why and how FMs benefit time series analysis. To address this gap, our survey adopts a methodology-centric classification, delineating various pivotal elements of time-series FMs, including model architectures, pre-training techniques, adaptation methods, and data modalities. Overall, this survey serves to consolidate the latest advancements in FMs pertinent to time series analysis, accentuating their theoretical underpinnings, recent strides in development, and avenues for future exploration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑