arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.11620cs.LGcs.AI

具有可解释性的ST-Tree用于多变量时间序列分类

ST-Tree with Interpretability for Multivariate Time Series Classification

Shandong Normal University(山东师范大学);Shandong University(山东大学)

Mingsen Du, Yanxuan Wei, Yingxia Tang, Xiangwei Zheng, Shoushui Wei, Cun Ji

AI总结:

针对多变量时间序列分类中深度模型缺乏可解释性而传统决策树准确率低的问题,提出ST-Tree模型,结合Swin Transformer与神经树,在提升分类准确率的同时提供可解释的决策过程。

摘要:

多变量时间序列分类在实际应用中非常重要,且是一项具有挑战性的任务。然而,诸如Transformers等深度神经网络模型在多变量时间序列分类中展现出高准确率,但缺乏可解释性,无法为决策过程提供深入见解。另一方面,基于决策树分类器的传统方法提供了清晰的决策过程,但准确率相对较低。Swin Transformer (ST) 通过利用自注意力机制来捕捉细粒度的局部模式和全局模式,从而解决了这些问题。它还能对多尺度特征表示学习进行建模,从而提供更全面的时间序列特征表示。为了应对上述挑战,我们提出了具有可解释性的ST-Tree用于多变量时间序列分类。具体而言,ST-Tree模型将ST作为骨干网络与一个额外的神经树模型相结合。这种整合使我们能够充分利用ST在学习时间序列上下文方面的优势,同时通过神经树提供可解释的决策过程。这使得研究人员能够对模型的决策过程获得清晰的见解,并提取有意义的解释。通过在10个UEA数据集上的实验评估,我们证明了ST-Tree模型提高了多变量时间序列分类任务的准确率,并通过可视化不同数据集的决策过程提供了可解释性。

英文摘要:

Multivariate time series classification is of great importance in practical applications and is a challenging task. However, deep neural network models such as Transformers exhibit high accuracy in multivariate time series classification but lack interpretability and fail to provide insights into the decision-making process. On the other hand, traditional approaches based on decision tree classifiers offer clear decision processes but relatively lower accuracy. Swin Transformer (ST) addresses these issues by leveraging self-attention mechanisms to capture both fine-grained local patterns and global patterns. It can also model multi-scale feature representation learning, thereby providing a more comprehensive representation of time series features. To tackle the aforementioned challenges, we propose ST-Tree with interpretability for multivariate time series classification. Specifically, the ST-Tree model combines ST as the backbone network with an additional neural tree model. This integration allows us to fully leverage the advantages of ST in learning time series context while providing interpretable decision processes through the neural tree. This enables researchers to gain clear insights into the model's decision-making process and extract meaningful interpretations. Through experimental evaluations on 10 UEA datasets, we demonstrate that the ST-Tree model improves accuracy in multivariate time series classification tasks and provides interpretability through visualizing the decision-making process across different datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑