arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.09779cs.LGstat.ML
收藏

深度马尔可夫时空分解

Deep Markov Spatio-Temporal Factorization

Northeastern University(东北大学);University of Oregon(俄勒冈大学)

Amirreza Farnoosh, Behnaz Rezaei, Eli Zachary Sennesh, Zulqarnain Khan, Jennifer Dy, Ajay Satpute, J Benjamin Hutchinson, Jan-Willem van de Meent, Sarah Ostadabbas

摘要:

我们介绍了深度马尔可夫时空分解(DMSTF),时空数据的动态分析的生成模型。与其他因子分析方法一样,DMSTF通过时间相关权重和空间相关因子之间的乘积来近似高维数据。这些权重和因素反过来表示在使用随机变分推理推断的低维潜伏期。DMSTF的创新之处在于,我们将权重参数化为具有离散潜时的深度马尔可夫先验可扩展性,从而能够表征非线性多模态时间动态,并进行多维时间序列预测。DMSTF学习一个低维的空间潜在生成参数化的空间因素或其功能的形式,以适应高空间维度。我们参数化相应的变分分布使用双向递归网络在低级别的潜在表示。这产生了一系列灵活的分层深度生成因子分析模型,这些模型可以扩展以执行时间序列聚类或在存在控制信号的情况下执行因子分析。我们的实验,其中包括模拟和真实世界的数据,表明DMSTF优于相关方法的预测性能方面看不见的数据,揭示了有意义的集群的数据,并在各种领域进行预测与潜在的非线性时间转换。

英文摘要:

We introduce deep Markov spatio-temporal factorization (DMSTF), a generative model for dynamical analysis of spatio-temporal data. Like other factor analysis methods, DMSTF approximates high dimensional data by a product between time dependent weights and spatially dependent factors. These weights and factors are in turn represented in terms of lower dimensional latents inferred using stochastic variational inference. The innovation in DMSTF is that we parameterize weights in terms of a deep Markovian prior extendable with a discrete latent, which is able to characterize nonlinear multimodal temporal dynamics, and perform multidimensional time series forecasting. DMSTF learns a low dimensional spatial latent to generatively parameterize spatial factors or their functional forms in order to accommodate high spatial dimensionality. We parameterize the corresponding variational distribution using a bidirectional recurrent network in the low-level latent representations. This results in a flexible family of hierarchical deep generative factor analysis models that can be extended to perform time series clustering or perform factor analysis in the presence of a control signal. Our experiments, which include simulated and real-world data, demonstrate that DMSTF outperforms related methodologies in terms of predictive performance for unseen data, reveals meaningful clusters in the data, and performs forecasting in a variety of domains with potentially nonlinear temporal transitions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑