arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.17154cs.LG
收藏

面向多时间序列的高效可解释非线性建模

Efficient Interpretable Nonlinear Modeling for Multiple Time Series

University of Agder(阿格德大学);Simula Metropolitan Center for Digital Engineering(西姆拉大都会数字工程中心)

Kevin Roy, Luis Miguel Lopez-Ramos, Baltasar Beferull-Lozano

AI总结:

针对多时间序列依赖发现与预测,本文提出潜在线性VAR加逐传感器可逆非线性映射的高效可解释模型,并用稀疏正则与定制优化算法提升系数支撑辨识和预测效果。

摘要:

基于核机器或深度神经网络的预测性线性与非线性模型已被用于发现时间序列之间的依赖关系。本文提出一种用于多时间序列的高效非线性建模方法,其复杂度与线性向量自回归(VAR)模型相当,同时仍能纳入不同时间序列变量之间的非线性交互。建模假设是,时间序列集合通过两个步骤生成:首先,在潜在空间中存在一个线性VAR过程;其次,对每个传感器应用一组可逆且Lipschitz连续的非线性映射,即从每个潜在变量到测量空间中一个变量的逐分量映射。VAR系数辨识提供了上述变量之间依赖关系的拓扑表示。所提方法使用可逆神经网络对每个逐分量非线性进行建模,并对VAR系数施加稀疏性,以反映实际应用中通常存在的简约依赖关系。为高效求解所构造的优化问题,本文设计了一种定制算法,结合近邻梯度下降、随机原始-对偶更新以及投影来强制执行相应约束。在合成数据集和真实数据集上的实验结果表明,与当前最先进方法相比,所提算法以简约方式改进了VAR系数支撑集的辨识,同时也提升了时间序列预测性能。

英文摘要:

Predictive linear and nonlinear models based on kernel machines or deep neural networks have been used to discover dependencies among time series. This paper proposes an efficient nonlinear modeling approach for multiple time series, with a complexity comparable to linear vector autoregressive (VAR) models while still incorporating nonlinear interactions among different time-series variables. The modeling assumption is that the set of time series is generated in two steps: first, a linear VAR process in a latent space, and second, a set of invertible and Lipschitz continuous nonlinear mappings that are applied per sensor, that is, a component-wise mapping from each latent variable to a variable in the measurement space. The VAR coefficient identification provides a topology representation of the dependencies among the aforementioned variables. The proposed approach models each component-wise nonlinearity using an invertible neural network and imposes sparsity on the VAR coefficients to reflect the parsimonious dependencies usually found in real applications. To efficiently solve the formulated optimization problems, a custom algorithm is devised combining proximal gradient descent, stochastic primal-dual updates, and projection to enforce the corresponding constraints. Experimental results on both synthetic and real data sets show that the proposed algorithm improves the identification of the support of the VAR coefficients in a parsimonious manner while also improving the time-series prediction, as compared to the current state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑