arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.06247cs.LG
收藏

事件序列的连续时间卷积模型

Continuous-time convolutions model of event sequences

Skolkovo Institute of Science and Technology(斯科尔科沃科学技术学院);Sber AI Lab(Sber AI实验室);Choco Communication(Choco通信公司);Center for Digital Technology and Management(数字技术与管理中心)
Vladislav Zhuzhel, Vsevolod Grabar, Galina Boeva, Artem Zabolotnyi, Alexander Stepikin, Vladimir Zholobov, Maria Ivanova, Mikhail Orlov, Ivan Kireev, Evgeny Bur… 展开作者

Vladislav Zhuzhel, Vsevolod Grabar, Galina Boeva, Artem Zabolotnyi, Alexander Stepikin, Vladimir Zholobov, Maria Ivanova, Mikhail Orlov, Ivan Kireev, Evgeny Burnaev, Rodrigo Rivera-Castro, Alexey Zaytsev

AI总结:

本文提出COTIC,一种基于连续卷积层的高效事件序列建模方法,以低计算开销捕获复杂时序依赖,并在下一事件时间与类型预测上显著优于现有模型。

摘要:

事件序列经常出现在数据挖掘中。对这些序列建模面临两个主要挑战:方法上的和计算上的。在方法上,事件序列是非均匀且稀疏的,使得传统模型不适用。在计算上,海量数据以及每个序列的显著长度需要复杂且高效的模型。现有解决方案,如循环神经网络和Transformer神经网络,依赖于在每个时刻定义的参数化强度函数。这些函数要么在表示复杂事件序列的能力上受限,要么明显低效。我们提出COTIC,一种基于高效卷积神经网络的方法,旨在处理事件在时间上非均匀发生的情况。本文引入了一个连续卷积层,使模型能够以很少的计算开销捕获复杂依赖关系,例如自激励效应。COTIC在预测下一个事件时间和类型方面优于现有模型,平均排名为1.5,而最接近的竞争对手为3.714。此外,COTIC生成有效嵌入的能力展示了其在各种下游任务中的潜力。我们的代码已开源,可在https://github.com/VladislavZh/COTIC获取。

英文摘要:

Event sequences often emerge in data mining. Modeling these sequences presents two main challenges: methodological and computational. Methodologically, event sequences are non-uniform and sparse, making traditional models unsuitable. Computationally, the vast amount of data and the significant length of each sequence necessitate complex and efficient models. Existing solutions, such as recurrent and transformer neural networks, rely on parametric intensity functions defined at each moment. These functions are either limited in their ability to represent complex event sequences or notably inefficient. We propose COTIC, a method based on an efficient convolution neural network designed to handle the non-uniform occurrence of events over time. Our paper introduces a continuous convolution layer, allowing a model to capture complex dependencies, including, e.g., the self-excitement effect, with little computational expense. COTIC outperforms existing models in predicting the next event time and type, achieving an average rank of 1.5 compared to 3.714 for the nearest competitor. Furthermore, COTIC`s ability to produce effective embeddings demonstrates its potential for various downstream tasks. Our code is open and available at: https://github.com/VladislavZh/COTIC.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑