arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.00388cs.LGcs.AIstat.ML
收藏

基于累积分布函数的通用时间点过程

Cumulative Distribution Function based General Temporal Point Processes

City University of Hong Kong(香港城市大学);ByteDance Research(字节跳动研究院);Michigan State University(密歇根州立大学);HIT, Shenzhen(哈尔滨工业大学(深圳));Jinan University(暨南大学)

Maolin Wang, Yu Pan, Zenglin Xu, Ruocheng Guo, Xiangyu Zhao, Wanyu Wang, Yiqi Wang, Zitao Liu, Langming Liu

AI总结:

针对深度时间点过程在强度建模、积分计算及长程依赖捕捉上的局限,提出基于累积分布函数的CuFun模型,采用单调神经网络表征CDF并以历史事件为缩放因子,提升了建模适应性与精度。

摘要:

时间点过程(Temporal Point Processes, TPPs)在社交网络、电子商务等多个领域的事件序列建模中发挥着关键作用,极大推动了推荐系统与信息检索策略的发展。通过分析用户交互、交易等事件,TPPs能为行为模式研究提供有价值的洞见,助力未来趋势预测。但由于这类模式的复杂性,准确预测未来事件仍是一项艰巨挑战。神经网络与TPPs的融合推动了先进深度TPP模型的发展,这类模型虽擅长处理复杂非线性时序数据,但在强度函数建模上存在局限,面临积分计算的复杂度问题,且难以有效捕捉长程时序依赖关系。本研究提出CuFun模型,这是一种以累积分布函数(Cumulative Distribution Function, CDF)为核心的新型TPP方法。CuFun的独特之处在于采用单调神经网络进行CDF表征,并将历史事件作为缩放因子,这一创新显著提升了模型在各类数据场景下的适应性与精度。该方法解决了传统TPP建模中固有的若干关键问题:简化了对数似然计算,突破了预定义密度函数形式的适用限制,且能有效捕捉长程时序模式。本研究的贡献包括:提出了首个基于CDF的TPP模型;开发了将历史事件信息融入未来事件预测的方法;通过在合成数据集与真实世界数据集上开展大量实验,实证验证了CuFun的有效性。

英文摘要:

Temporal Point Processes (TPPs) hold a pivotal role in modeling event sequences across diverse domains, including social networking and e-commerce, and have significantly contributed to the advancement of recommendation systems and information retrieval strategies. Through the analysis of events such as user interactions and transactions, TPPs offer valuable insights into behavioral patterns, facilitating the prediction of future trends. However, accurately forecasting future events remains a formidable challenge due to the intricate nature of these patterns. The integration of Neural Networks with TPPs has ushered in the development of advanced deep TPP models. While these models excel at processing complex and nonlinear temporal data, they encounter limitations in modeling intensity functions, grapple with computational complexities in integral computations, and struggle to capture long-range temporal dependencies effectively. In this study, we introduce the CuFun model, representing a novel approach to TPPs that revolves around the Cumulative Distribution Function (CDF). CuFun stands out by uniquely employing a monotonic neural network for CDF representation, utilizing past events as a scaling factor. This innovation significantly bolsters the model's adaptability and precision across a wide range of data scenarios. Our approach addresses several critical issues inherent in traditional TPP modeling: it simplifies log-likelihood calculations, extends applicability beyond predefined density function forms, and adeptly captures long-range temporal patterns. Our contributions encompass the introduction of a pioneering CDF-based TPP model, the development of a methodology for incorporating past event information into future event prediction, and empirical validation of CuFun's effectiveness through extensive experimentation on synthetic and real-world datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑