arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.04550cs.LGcs.CL
收藏

SeDyT:一个基于动态实体嵌入的多步事件预测框架

SeDyT: A General Framework for Multi-Step Event Forecasting via Sequence Modeling on Dynamic Entity Embeddings

University of Southern California(南加州大学);US Army Research Lab(美国陆军研究实验室)

Hongkuan Zhou, James Orme-Rogers, Rajgopal Kannan, Viktor Prasanna

摘要:

时态知识图谱以主题、关系、对象和时间戳的形式存储事件,这些事件通常由动态异构图表示。事件预测是时态知识图谱推理中的一个关键而具有挑战性的任务,它预测未来事件的主体或客体。为了在未来获得多步的时间嵌入,现有的方法学习生成模型,捕获所观察到的事件的联合分布。为了降低高计算成本,这些方法依赖于不切实际的假设的独立性和近似的训练和推理。在这项工作中,我们提出了SeDyT,这是一个判别框架,它对动态实体嵌入进行序列建模,以解决多步事件预测问题。SeDyT由两个组件组成:一个时间图神经网络,它生成过去的动态实体嵌入,一个序列模型,它预测未来的实体嵌入。与生成模型相比,SeDyT不依赖于任何基于启发式的概率模型,并且在训练和推理方面都具有较低的计算复杂度。SeDyT与大多数时间图神经网络和序列模型兼容。我们还设计了一种有效的训练方法,在一个梯度下降传播中训练两个组件。我们在五个流行的数据集上评估了SeDyT的性能。通过结合时间图神经网络模型和序列模型,当不使用验证集时,SeDyT实现了平均2.4%的MRR改善,当使用验证集时,MRR改善超过10%。

英文摘要:

Temporal Knowledge Graphs store events in the form of subjects, relations, objects, and timestamps which are often represented by dynamic heterogeneous graphs. Event forecasting is a critical and challenging task in Temporal Knowledge Graph reasoning that predicts the subject or object of an event in the future. To obtain temporal embeddings multi-step away in the future, existing methods learn generative models that capture the joint distribution of the observed events. To reduce the high computation costs, these methods rely on unrealistic assumptions of independence and approximations in training and inference. In this work, we propose SeDyT, a discriminative framework that performs sequence modeling on the dynamic entity embeddings to solve the multi-step event forecasting problem. SeDyT consists of two components: a Temporal Graph Neural Network that generates dynamic entity embeddings in the past and a sequence model that predicts the entity embeddings in the future. Compared with the generative models, SeDyT does not rely on any heuristic-based probability model and has low computation complexity in both training and inference. SeDyT is compatible with most Temporal Graph Neural Networks and sequence models. We also design an efficient training method that trains the two components in one gradient descent propagation. We evaluate the performance of SeDyT on five popular datasets. By combining temporal Graph Neural Network models and sequence models, SeDyT achieves an average of 2.4% MRR improvement when not using the validation set and more than 10% MRR improvement when using the validation set.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑