arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.02358cs.LGcs.AI
收藏

用基础模型赋能时间序列分析:一项全面综述

Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey

The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));The Hong Kong University of Science and Technology(香港科学与技术大学);Shanghai University of Finance and Economics(上海财经大学)

Jiexia Ye, Yongzi Yu, Weiqi Zhang, Le Wang, Jia Li, Fugee Tsung

AI总结:

本文是一篇全面综述,从模态感知和挑战导向的视角,系统总结了基于时间序列、语言和视觉等不同模态预训练的基础模型在时间序列分析中的应用、挑战、解决方案及未来方向。

摘要:

时间序列数据在多样化的现实世界应用中无处不在,使得时间序列分析至关重要。传统方法在很大程度上是特定于任务的,提供的功能有限且可迁移性差。近年来,基础模型凭借其卓越的跨任务可迁移性、零样本/少样本学习能力以及多模态整合能力,彻底改变了NLP和CV。这一成功促使越来越多的人致力于探索基础模型以解决时间序列建模挑战。尽管该领域早期阶段已发表一些教程和综述,但近期快速发展的步伐需要更全面、更深入的综述来涵盖最新进展。我们的综述旨在通过引入模态感知、挑战导向的视角来填补这一空白,该视角揭示了在不同模态上预训练的基础模型在适应时间序列任务时面临的不同障碍。基于这一视角,我们提出了一种按预训练模态(时间序列、语言和视觉)组织的现有工作分类法,分析了特定模态的挑战并归类了相应的解决方案,讨论了它们的优势和局限性。除此之外,我们回顾了现实世界应用以说明特定领域的进展,提供了开源代码,并对这一快速发展领域的潜在未来研究方向进行了总结。

英文摘要:

Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent years, foundation models have revolutionized NLP and CV with their remarkable cross-task transferability, zero-/few-shot learning capabilities, and multimodal integration capacity. This success has motivated increasing efforts to explore foundation models for addressing time series modeling challenges. Although some tutorials and surveys were published in the early stages of this field, the rapid pace of recent developments necessitates a more comprehensive and in-depth synthesis to cover the latest advances. Our survey aims to fill this gap by introducing a modality-aware, challenge-oriented perspective, which reveals how foundation models pre-trained on different modalities face distinct hurdles when adapted to time series tasks. Building on this perspective, we propose a taxonomy of existing works organized by pre-training modality (time series, language, and vision), analyze modality-specific challenges and categorize corresponding solutions, discussing their advantages and limitations. Beyond this, we review real-world applications to illustrate domain-specific advancements, provide open-source codes, and conclude with potential future research directions in this rapidly evolving field.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑