arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.07031cs.LGcs.AI
收藏

基于受控微分方程的Hawkes过程

Hawkes Process Based on Controlled Differential Equations

Yonsei University(延世大学)

Minju Jo, Seungji Kook, Noseong Park

AI总结:

针对现有基于神经网络的Hawkes过程模型无法捕捉不规则时间动力学及启发式计算对数似然的局限,提出基于受控微分方程的HP-CDE方法,实现连续读取数据以精确计算对数似然,并在4个真实数据集上显著优于现有方法。

摘要:

Hawkes过程是用于建模社会扩散等领域中序列事件发生(即发生动力学)的流行框架。在现实场景中,事件间的到达时间是不规则的。然而,现有的基于神经网络的Hawkes过程模型不仅i) 无法捕捉这种复杂的不规则动力学,而且ii) 依赖启发式方法来计算事件的对数似然,因为它们大多基于为规则离散输入设计的神经网络。为此,我们提出了基于受控微分方程的Hawkes过程(HP-CDE)的概念,采用了神经受控微分方程(neural CDE)技术,该技术类似于连续RNN。由于HP-CDE连续读取数据,i) 不规则时间序列数据集可以得到妥善处理,保留其不均匀的时间空间,ii) 对数似然可以被精确计算。此外,由于Hawkes过程和neural CDE最初都是为了建模复杂的人类行为动力学而开发的,基于neural CDE的Hawkes过程在建模此类发生动力学方面非常成功。在4个真实数据集上的实验中,我们的方法以非平凡的幅度优于现有方法。

英文摘要:

Hawkes processes are a popular framework to model the occurrence of sequential events, i.e., occurrence dynamics, in several fields such as social diffusion. In real-world scenarios, the inter-arrival time among events is irregular. However, existing neural network-based Hawkes process models not only i) fail to capture such complicated irregular dynamics, but also ii) resort to heuristics to calculate the log-likelihood of events since they are mostly based on neural networks designed for regular discrete inputs. To this end, we present the concept of Hawkes process based on controlled differential equations (HP-CDE), by adopting the neural controlled differential equation (neural CDE) technology which is an analogue to continuous RNNs. Since HP-CDE continuously reads data, i) irregular time-series datasets can be properly treated preserving their uneven temporal spaces, and ii) the log-likelihood can be exactly computed. Moreover, as both Hawkes processes and neural CDEs are first developed to model complicated human behavioral dynamics, neural CDE-based Hawkes processes are successful in modeling such occurrence dynamics. In our experiments with 4 real-world datasets, our method outperforms existing methods by non-trivial margins.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑