arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.01588cs.LGcs.AI
收藏

频谱文本融合:一种频率感知的多模态时间序列预测方法

Spectral Text Fusion: A Frequency-Aware Approach to Multimodal Time-Series Forecasting

Applied Artificial Intelligence Initiative(应用人工智能计划);Deakin University(迪金大学)

Huu Hiep Nguyen, Minh Hoang Nguyen, Dung Nguyen, Hung Le

AI总结:

提出SpecTF框架,通过频谱分解将文本信息与时间序列在频域融合,利用轻量级交叉注意力机制自适应重加权频带,显著提升多模态时间序列预测性能。

摘要:

多模态时间序列预测在实际应用中至关重要,决策依赖于数值数据和上下文信号。核心挑战在于有效结合时间数值模式与其他模态(如文本)中嵌入的上下文。现有方法大多逐步对齐文本特征与时间序列模式,但忽略了上下文信息(如时间序列周期和动态变化)的多尺度时间影响。频谱分解通过将时间序列分离为捕捉短期变化和长期趋势的频率分量,可以解决局部对齐与全局文本上下文之间的不匹配。本文提出SpecTF,一个简单而有效的框架,在频域中整合文本数据对时间序列的影响。我们的方法提取文本嵌入,将其投影到频域,并通过轻量级交叉注意力机制与时间序列的频谱分量融合。这根据文本相关性自适应地重加权频带,然后将结果映射回时域进行预测。实验结果表明,SpecTF在多种多模态时间序列数据集上显著优于最先进的模型,同时使用的参数更少。代码可在该 https URL 获取。

英文摘要:

Multimodal time series forecasting is crucial in real-world applications, where decisions depend on both numerical data and contextual signals. The core challenge is to effectively combine temporal numerical patterns with the context embedded in other modalities, such as text. While most existing methods align textual features with time-series patterns one step at a time, they neglect the multiscale temporal influences of contextual information such as time-series cycles and dynamic shifts. This mismatch between local alignment and global textual context can be addressed by spectral decomposition, which separates time series into frequency components capturing both short-term changes and long-term trends. In this paper, we propose SpecTF, a simple yet effective framework that integrates the effect of textual data on time series in the frequency domain. Our method extracts textual embeddings, projects them into the frequency domain, and fuses them with the time series' spectral components using a lightweight cross-attention mechanism. This adaptively reweights frequency bands based on textual relevance before mapping the results back to the temporal domain for predictions. Experimental results demonstrate that SpecTF significantly outperforms state-of-the-art models across diverse multi-modal time series datasets while utilizing considerably fewer parameters. Code is available at https://github.com/hiepnh137/SpecTF.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑