arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.06220cs.LGcs.AI
收藏

CSformer:结合通道独立性与混合的鲁棒多元时间序列预测

CSformer: Combining Channel Independence and Mixing for Robust Multivariate Time Series Forecasting

Sichuan University(四川大学);University of Electronic Science and Technology of China(电子科技大学);State Grid Sichuan Electric Power Research Institute(国网四川电力科学研究院)

Haoxin Wang, Yipeng Mo, Kunlan Xiang, Nan Yin, Honghe Dai, Bixiong Li, Songhai Fan, Site Mo

AI总结:

针对多元时间序列预测中通道独立性导致信息丢失的问题,提出先通道独立再混合的CSformer框架,采用两阶段多头自注意力及参数共享,结合序列与通道适配器,在真实数据集上取得最先进性能。

摘要:

在多元时间序列分析领域,通道独立性的概念日益被采用,因其能够消除噪声和不相关变量的影响而展现出卓越的性能。然而,这种概念往往简化了通道间复杂的交互,可能导致信息丢失。为应对这一挑战,我们提出了一种先通道独立再混合的策略。基于此策略,我们引入了CSformer,一种具有两阶段多头自注意力机制的新型框架。该机制旨在提取并整合通道特定信息和序列特定信息。独特的是,CSformer采用参数共享来增强这两类信息之间的协同效应。此外,我们的框架有效整合了序列适配器和通道适配器,显著提升了模型在不同维度上识别重要信息的能力。在多个真实世界数据集上的广泛实验表明,CSformer在整体性能上达到了最先进的结果。

英文摘要:

In the domain of multivariate time series analysis, the concept of channel independence has been increasingly adopted, demonstrating excellent performance due to its ability to eliminate noise and the influence of irrelevant variables. However, such a concept often simplifies the complex interactions among channels, potentially leading to information loss. To address this challenge, we propose a strategy of channel independence followed by mixing. Based on this strategy, we introduce CSformer, a novel framework featuring a two-stage multiheaded self-attention mechanism. This mechanism is designed to extract and integrate both channel-specific and sequence-specific information. Distinctively, CSformer employs parameter sharing to enhance the cooperative effects between these two types of information. Moreover, our framework effectively incorporates sequence and channel adapters, significantly improving the model's ability to identify important information across various dimensions. Extensive experiments on several real-world datasets demonstrate that CSformer achieves state-of-the-art results in terms of overall performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑