arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.12413cs.LG
收藏

神经ODE过程

Neural ODE Processes

University College London(伦敦大学学院);University of Cambridge(剑桥大学)

Alexander Norcliffe, Cristian Bodnar, Ben Day, Jacob Moss, Pietro Liò

摘要:

神经常微分方程(NODE)使用神经网络来模拟系统状态的瞬时变化率。然而,尽管它们明显适用于动态治理的时间序列,NODE提出了一些缺点。首先,它们无法适应传入的数据点,这是时间自然方向对实时应用的基本要求。其次,时间序列通常由一组稀疏的测量值组成,这些测量值可以由许多可能的潜在动态来解释。NODE不能捕捉这种不确定性。相比之下,神经过程(NP)是一系列提供不确定性估计和快速数据自适应的模型,但缺乏对时间流的显式处理。为了解决这些问题,我们引入了神经ODE过程(NDP),这是一类由神经ODE分布确定的新的随机过程。通过在底层ODE上保持自适应的数据依赖分布,我们证明了我们的模型可以成功地从几个数据点捕获低维系统的动力学。同时,我们证明了NDP扩展到具有未知潜在动态的具有挑战性的高维时间序列,例如旋转MNIST数字。

英文摘要:

Neural Ordinary Differential Equations (NODEs) use a neural network to model the instantaneous rate of change in the state of a system. However, despite their apparent suitability for dynamics-governed time-series, NODEs present a few disadvantages. First, they are unable to adapt to incoming data points, a fundamental requirement for real-time applications imposed by the natural direction of time. Second, time series are often composed of a sparse set of measurements that could be explained by many possible underlying dynamics. NODEs do not capture this uncertainty. In contrast, Neural Processes (NPs) are a family of models providing uncertainty estimation and fast data adaptation but lack an explicit treatment of the flow of time. To address these problems, we introduce Neural ODE Processes (NDPs), a new class of stochastic processes determined by a distribution over Neural ODEs. By maintaining an adaptive data-dependent distribution over the underlying ODE, we show that our model can successfully capture the dynamics of low-dimensional systems from just a few data points. At the same time, we demonstrate that NDPs scale up to challenging high-dimensional time-series with unknown latent dynamics such as rotating MNIST digits.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑