arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.10585cs.LGcs.AI
收藏

变分神经时间点过程

Variational Neural Temporal Point Process

Korea Advanced Institute of Science and Technology (KAIST)(韩国高等科学技术院(KAIST));INEEJI

Deokjun Eom, Sehyun Lee, Jaesik Choi

摘要:

时间点过程是一个随机过程,它预测哪种类型的事件可能发生,以及事件何时发生。在日常生活中有各种各样的发生动力学的例子,这是重要的训练时间动力学和解决两个不同的预测问题,时间和类型的预测。特别是,基于深度神经网络的模型已经超过了统计模型,如霍克斯过程和泊松过程。然而,许多现有的方法过度适应特定的事件,而不是学习和预测各种事件类型。因此,这些方法不能处理事件之间的修改关系,不能很好地预测时间点过程的强度函数。针对这些问题,本文提出了一种变分神经时间点过程(VNTPP)。我们引入了推理和生成网络,并在深层神经网络上训练了一种潜变量分布来处理随机性。利用隐变量的分布计算强度函数,从而可以更准确地预测事件类型和事件到达时间。我们根据经验证明,我们的模型可以概括各种事件类型的表示。此外,我们定量和定性地表明,我们的模型在合成和真实世界数据集上的性能优于其他基于深度神经网络的模型和统计过程。

英文摘要:

A temporal point process is a stochastic process that predicts which type of events is likely to happen and when the event will occur given a history of a sequence of events. There are various examples of occurrence dynamics in the daily life, and it is important to train the temporal dynamics and solve two different prediction problems, time and type predictions. Especially, deep neural network based models have outperformed the statistical models, such as Hawkes processes and Poisson processes. However, many existing approaches overfit to specific events, instead of learning and predicting various event types. Therefore, such approaches could not cope with the modified relationships between events and fail to predict the intensity functions of temporal point processes very well. In this paper, to solve these problems, we propose a variational neural temporal point process (VNTPP). We introduce the inference and the generative networks, and train a distribution of latent variable to deal with stochastic property on deep neural network. The intensity functions are computed using the distribution of latent variable so that we can predict event types and the arrival times of the events more accurately. We empirically demonstrate that our model can generalize the representations of various event types. Moreover, we show quantitatively and qualitatively that our model outperforms other deep neural network based models and statistical processes on synthetic and real-world datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑