arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2401.01243cs.LG
收藏

共演化黎曼空间上的对比序列交互网络学习

Contrastive Sequential Interaction Network Learning on Co-Evolving Riemannian Spaces

North China Electric Power University(华北电力大学);Beijing University of Posts and Telecommunications(北京邮电大学);University of California, Davis(加州大学戴维斯分校);State Grid Handan Electric Power Supply Company(国网邯郸供电公司);Shijiazhuang Institute of Railway Technology(石家庄铁路职业技术学院);University of Illinois at Chicago(伊利诺伊大学芝加哥分校)

Li Sun, Junda Ye, Jiawei Zhang, Yong Yang, Mingsheng Liu, Feiyang Wang, Philip S. Yu

AI总结:

提出新型对比模型CSINCERE,通过跨空间聚合、神经曲率估计器和重新加权共对比,在共演化黎曼空间中无标签预测序列交互,在5个数据集上优于现有方法。

摘要:

序列交互网络通常出现在各种应用中,例如推荐系统。在此,推断未来交互具有根本的重要性,而以往的努力主要集中在经典零曲率欧几里得空间的动态上。尽管以前的方法取得了有希望的结果,但一系列重大问题仍然在很大程度上悬而未决:在二部图性质上,将用户和物品节点放置在同一个空间中而不顾它们固有的差异是否合适?在网络动态上,表示空间是否会随着新交互的不断到达而演化,而不是一个固定曲率空间?在学习范式上,我们能否摆脱获取成本高昂的标签信息?为了解决上述问题,我们提出了一种用于共演化黎曼空间上序列交互网络学习的新型对比模型CSINCERE。据我们所知,我们是首个引入一对共演化表示空间(而非单一或静态空间)的人,并为序列交互网络提出了共对比学习。在CSINCERE中,我们制定了跨空间聚合用于不同黎曼几何表示空间之间的消息传递,并设计了基于Ricci曲率的神经曲率估计器来建模空间随时间的演化。此后,我们提出了序列网络时间视图之间的重新加权共对比,使得这对黎曼空间相互交互以进行无标签的交互预测。在5个公开数据集上的实证结果表明了CSINCERE相对于最先进方法的优越性。

英文摘要:

The sequential interaction network usually find itself in a variety of applications, e.g., recommender system. Herein, inferring future interaction is of fundamental importance, and previous efforts are mainly focused on the dynamics in the classic zero-curvature Euclidean space. Despite the promising results achieved by previous methods, a range of significant issues still largely remains open: On the bipartite nature, is it appropriate to place user and item nodes in one identical space regardless of their inherent difference? On the network dynamics, instead of a fixed curvature space, will the representation spaces evolve when new interactions arrive continuously? On the learning paradigm, can we get rid of the label information costly to acquire? To address the aforementioned issues, we propose a novel Contrastive model for Sequential Interaction Network learning on Co-Evolving RiEmannian spaces, CSINCERE. To the best of our knowledge, we are the first to introduce a couple of co-evolving representation spaces, rather than a single or static space, and propose a co-contrastive learning for the sequential interaction network. In CSINCERE, we formulate a Cross-Space Aggregation for message-passing across representation spaces of different Riemannian geometries, and design a Neural Curvature Estimator based on Ricci curvatures for modeling the space evolvement over time. Thereafter, we present a Reweighed Co-Contrast between the temporal views of the sequential network, so that the couple of Riemannian spaces interact with each other for the interaction prediction without labels. Empirical results on 5 public datasets show the superiority of CSINCERE over the state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑