arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.00635cs.LGstat.ML
收藏

带变点的变分神经随机微分方程

Variational Neural Stochastic Differential Equations with Change Points

J.P. Morgan AI Research(摩根大通人工智能研究院);University at Buffalo(布法罗大学)

Yousef El-Laham, Zhongchang Sun, Haibei Zhu, Tucker Balch, Svitlana Vyetrenko

AI总结:

本研究提出基于VAE框架的带变点神经SDE模型与训练方法,仅需初始状态高斯先验,通过两种迭代变点估计算法实现分布偏移时间序列建模,经理论与实验验证具备良好表达能力。

摘要:

在本研究中,我们探索使用神经随机微分方程(neural SDEs)对时间序列数据中的变点进行建模。我们基于变分自编码器(VAE)框架提出了一种全新的模型公式与训练流程,用于将时间序列建模为神经SDE。与现有将神经SDE作为VAE训练的算法不同,我们提出的算法仅需要潜在随机过程初始状态的高斯先验,而非整个潜在随机过程的维纳过程先验。我们开发了两种方法,用于对存在分布偏移的时间序列数据中的变点进行建模与估计。我们的迭代算法在更新神经SDE参数与更新变点之间交替进行,变点更新既可以采用基于最大似然的方法,也可以使用基于序贯似然比检验的变点检测算法。我们对所提出的变点检测方案进行了理论分析。最后,我们开展了实证评估,验证了所提模型的表达能力,结果表明该模型既能有效建模经典参数化SDE,也能有效处理部分存在分布偏移的真实数据集。

英文摘要:

In this work, we explore modeling change points in time-series data using neural stochastic differential equations (neural SDEs). We propose a novel model formulation and training procedure based on the variational autoencoder (VAE) framework for modeling time-series as a neural SDE. Unlike existing algorithms training neural SDEs as VAEs, our proposed algorithm only necessitates a Gaussian prior of the initial state of the latent stochastic process, rather than a Wiener process prior on the entire latent stochastic process. We develop two methodologies for modeling and estimating change points in time-series data with distribution shifts. Our iterative algorithm alternates between updating neural SDE parameters and updating the change points based on either a maximum likelihood-based approach or a change point detection algorithm using the sequential likelihood ratio test. We provide a theoretical analysis of this proposed change point detection scheme. Finally, we present an empirical evaluation that demonstrates the expressive power of our proposed model, showing that it can effectively model both classical parametric SDEs and some real datasets with distribution shifts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑