arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.11047cs.CVcs.AIcs.CE
收藏

从像素到预测:频谱图和视觉Transformer用于更好的时间序列预测

From Pixels to Predictions: Spectrogram and Vision Transformer for Better Time Series Forecasting

J. P. Morgan AI Research(摩根大通人工智能研究院)

Zhen Zeng, Rachneet Kaur, Suchetha Siddagangappa, Tucker Balch, Manuela Veloso

AI总结:

本文提出使用时间-频率频谱图作为时间序列的视觉表示,并采用视觉Transformer进行多模态学习,在多个领域数据集上优于统计基线、深度学习方法及其他视觉表示。

摘要:

时间序列预测在跨多个领域的决策中扮演着关键角色,但同时也带来了显著的挑战。近期研究探索了利用计算机视觉模型进行图像驱动的方法来应对这些挑战,通常采用折线图作为时间序列数据的视觉表示。在本文中,我们提出了一种新颖的方法,使用时间-频率频谱图作为时间序列数据的视觉表示。我们引入了视觉Transformer用于多模态学习,展示了我们的方法在不同领域多样化数据集上的优势。为了评估其有效性,我们将我们的方法与统计基线(EMA和ARIMA)、一种最先进的基于深度学习的方法(DeepAR)、其他时间序列数据的视觉表示(折线图图像)以及仅使用时间序列作为输入的消融研究进行了比较。我们的实验证明了利用频谱图作为时间序列数据视觉表示的益处,以及采用视觉Transformer在时间和频率域同时学习的优势。

英文摘要:

Time series forecasting plays a crucial role in decision-making across various domains, but it presents significant challenges. Recent studies have explored image-driven approaches using computer vision models to address these challenges, often employing lineplots as the visual representation of time series data. In this paper, we propose a novel approach that uses time-frequency spectrograms as the visual representation of time series data. We introduce the use of a vision transformer for multimodal learning, showcasing the advantages of our approach across diverse datasets from different domains. To evaluate its effectiveness, we compare our method against statistical baselines (EMA and ARIMA), a state-of-the-art deep learning-based approach (DeepAR), other visual representations of time series data (lineplot images), and an ablation study on using only the time series as input. Our experiments demonstrate the benefits of utilizing spectrograms as a visual representation for time series data, along with the advantages of employing a vision transformer for simultaneous learning in both the time and frequency domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑