arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1910.12469cs.LGstat.ML
收藏

通过有效采样从高维事件序列中学习潜在过程

Learning Latent Process from High-Dimensional Event Sequences via Efficient Sampling

Shanghai Jiao Tong University(上海交通大学);Nanjing University(南京大学)

Qitian Wu, Zixuan Zhang, Xiaofeng Gao, Junchi Yan, Guihai Chen

摘要:

我们的目标是在没有任何关于标记关系的先验知识的情况下对高维标记事件序列中的潜在动态进行建模。这类问题在以往的研究中很少涉及,它们将面临以下挑战:(1)高维标记及其之间的未知关系网络对潜在动态过程的建模构成了难以克服的障碍:(2)一个观察到的事件序列可能同时包含多个不同的相互依赖的事件链; 3)高维事件序列之间的距离难以很好地确定。为此,本文提出了一个面向高维事件序列生成的对抗性模仿学习框架,该框架可以分解为:1)一个潜在结构强度模型,该模型在没有显式网络的情况下估计相邻节点,并学习捕获观察序列上标记的潜在空间中的时间动态; 2)基于随机游走的高效生成模型,从自底向上的角度模拟高维事件序列的生成过程; 3)一个被指定为seq 2seq网络的优化奖励的事件发生器,以帮助生成器尽可能真实地输出事件序列。在人工数据集和真实数据集上的实验结果表明,该方法可以有效地检测标记之间的隐藏网络,并对未来的标记事件做出良好的预测,即使标记数量达到百万级。

英文摘要:

We target modeling latent dynamics in high-dimension marked event sequences without any prior knowledge about marker relations. Such problem has been rarely studied by previous works which would have fundamental difficulty to handle the arisen challenges: 1) the high-dimensional markers and unknown relation network among them pose intractable obstacles for modeling the latent dynamic process; 2) one observed event sequence may concurrently contain several different chains of interdependent events; 3) it is hard to well define the distance between two high-dimension event sequences. To these ends, in this paper, we propose a seminal adversarial imitation learning framework for high-dimension event sequence generation which could be decomposed into: 1) a latent structural intensity model that estimates the adjacent nodes without explicit networks and learns to capture the temporal dynamics in the latent space of markers over observed sequence; 2) an efficient random walk based generation model that aims at imitating the generation process of high-dimension event sequences from a bottom-up view; 3) a discriminator specified as a seq2seq network optimizing the rewards to help the generator output event sequences as real as possible. Experimental results on both synthetic and real-world datasets demonstrate that the proposed method could effectively detect the hidden network among markers and make decent prediction for future marked events, even when the number of markers scales to million level.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑