arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.23135cs.LGcs.AIcs.SI
收藏

DyGnROLE:动态图上边分类的非对称预训练

An Analysis of Role Semantics in Directed Dynamic Graph Modeling for Edge Classification

Tyler Bonnet, Marek Rei

AI总结:

本文提出DyGnROLE,通过非对称预训练学习动态图中源节点与目标节点的异构表示,解决边分类中源目标节点行为不对称性问题,实验表明其在有限标注数据下表现优异。

摘要:

在有向动态图上进行边分类需要建模源节点和目标节点之间交互的不对称行为模式和时间动态。然而,现有动态图架构大多依赖共享参数处理源和目标节点,缺乏系统性的角色感知建模。本文提出DyGnROLE(动态图节点-角色-导向潜在编码),一种基于Transformer的架构,通过分离源和目标表示。利用独立的嵌入表和角色语义位置编码,模型捕捉到每个角色独特的结构和时间上下文。在标注数据有限的边分类任务中,关键在于引入的自监督预训练目标:方向性角色对齐(DRA)。DRA通过训练源表示检索对应的目标表示,同时历史正掩码策略排除先前观察到的交互,以避免未来负比较。掩码引入了时间方向性的训练信号,使节点对从未见过到观察到逐步推进,之后关系仅能进一步对齐。在八个数据集上的四个边分类任务全面评估表明,DyGnROLE在有限标注数据下一致优于多种最先进的基线,突显了角色感知表示学习和非对称预训练在建模复杂有向交互中的重要性。

英文摘要:

Edge classification on directed dynamic graphs is critical for understanding evolving user-item interactions and behavioral patterns in recommender systems and social platforms. Existing dynamic graph architectures typically process these interactions using shared parameters for nodes with semantically distinct roles, including source, destination, query, and neighbor. While abundant supervision in tasks such as link prediction provides sufficient gradient signal for models to implicitly deduce role semantics and overcome this conflation, there are often far fewer labels available for edge classification. We hypothesize that in such regimes, the ability of models to implicitly separate roles is restricted, degrading downstream performance. To empirically investigate this relationship, we introduce an experimental framework for sequence-based models that explicitly disentangles functional roles using targeted embeddings and an asymmetric pretraining objective. By providing architectural priors for these roles, the framework serves as an evaluative vehicle to isolate and measure the resulting performance delta across a range of label budgets. Our empirical evaluation demonstrates that this explicit role disentanglement yields substantial and consistent relative performance gains over baselines. Furthermore, representational analyses reveal that the mechanism by which the framework provides these benefits is a bifurcation of source and destination latent spaces that improves linear separability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑