arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.00429cs.LGcs.AI
收藏

基于随机变分推断的通用状态空间模型时间序列聚类

Time Series Clustering with General State Space Models via Stochastic Variational Inference

Data Science and AI Innovation Research Promotion Center, Shiga University(滋贺大学数据科学与人工智能创新研究促进中心);Shiga University(滋贺大学)

Ryoichi Ishizuka, Takashi Imai, Kaoru Kawamoto

AI总结:

本文提出基于通用状态空间模型混合(MSSMs)的时间序列聚类方法,利用随机变分推断和归一化流估计潜变量,并通过贝叶斯信息准则确定聚类数,首次实现了计算可行的通用状态空间模型聚类。

摘要:

本文提出了一种基于模型的时间序列聚类新方法,使用通用状态空间模型(MSSMs)的混合模型。MSSMs的每个组件与每个聚类相关联。该方法的优势在于能够使用适合特定时间序列的时间序列模型。这不仅提高了聚类和预测精度,还增强了估计参数的可解释性。MSSMs的参数使用随机变分推断(变分推断的一种子类型)进行估计。该方法通过使用以归一化流作为变分估计器的神经网络来估计任意状态空间模型的潜变量。可以使用贝叶斯信息准则来估计聚类数量。此外,为了防止MSSMs收敛到局部最优,我们提出了几种优化技巧,包括一种称为熵退火的额外惩罚项。据我们所知,该方法是首个基于通用(可能为非线性、非高斯)状态空间模型且在计算上可行的时间序列聚类方法。在模拟数据集上的实验表明,该方法在聚类、参数估计和估计聚类数量方面是有效的。

英文摘要:

In this paper, we propose a novel method of model-based time series clustering with mixtures of general state space models (MSSMs). Each component of MSSMs is associated with each cluster. An advantage of the proposed method is that it enables the use of time series models appropriate to the specific time series. This not only improves clustering and prediction accuracy but also enhances the interpretability of the estimated parameters. The parameters of the MSSMs are estimated using stochastic variational inference, a subtype of variational inference. The proposed method estimates the latent variables of an arbitrary state space model by using neural networks with a normalizing flow as a variational estimator. The number of clusters can be estimated using the Bayesian information criterion. In addition, to prevent MSSMs from converging to the local optimum, we propose several optimization tricks, including an additional penalty term called entropy annealing. To our best knowledge, the proposed method is the first computationally feasible one for time series clustering based on general (possibly nonlinear, non-Gaussian) state space models. Experiments on simulated datasets show that the proposed method is effective for clustering, parameter estimation, and estimating the number of clusters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑