DBT-DMAE:一种有效的缺失数据下多元时间序列预训练模型
DBT-DMAE: An Effective Multivariate Time Series Pre-Train Model under Missing Data
摘要:
多变量时间序列(MTS)是一种与许多实际应用相关的通用数据类型。然而,MTS遭受缺失数据问题,这导致下游任务的退化甚至崩溃,例如预测和分类。当遇到多个下游任务时,并发缺失数据处理过程不可避免地会引起有偏估计和冗余训练问题。本文提出了一种通用的MTS预训练模型DBT-DMAE,以克服上述障碍。首先,通过引入动态位置嵌入和随机掩蔽处理,设计了缺失表征模块。其次,我们提出了一种自动编码器结构,以获得广义MTS编码表示,利用改进的TCN结构称为动态双向TCN作为基本单元,它集成了动态内核和时间翻转技巧,以有效地提取时间特征。最后,建立了整体馈入和损耗策略,以保证整个模型的充分训练。对比实验结果表明,DBT-DMAE优于其他国家的最先进的方法在六个现实世界的数据集和两个不同的下游任务。此外,烧蚀和可解释性的实验提供了验证的DBT-DMAE的子结构的有效性。
英文摘要:
Multivariate time series(MTS) is a universal data type related to many practical applications. However, MTS suffers from missing data problems, which leads to degradation or even collapse of the downstream tasks, such as prediction and classification. The concurrent missing data handling procedures could inevitably arouse the biased estimation and redundancy-training problem when encountering multiple downstream tasks. This paper presents a universally applicable MTS pre-train model, DBT-DMAE, to conquer the abovementioned obstacle. First, a missing representation module is designed by introducing dynamic positional embedding and random masking processing to characterize the missing symptom. Second, we proposed an auto-encoder structure to obtain the generalized MTS encoded representation utilizing an ameliorated TCN structure called dynamic-bidirectional-TCN as the basic unit, which integrates the dynamic kernel and time-fliping trick to draw temporal features effectively. Finally, the overall feed-in and loss strategy is established to ensure the adequate training of the whole model. Comparative experiment results manifest that the DBT-DMAE outperforms the other state-of-the-art methods in six real-world datasets and two different downstream tasks. Moreover, ablation and interpretability experiments are delivered to verify the validity of DBT-DMAE's substructures.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。