arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2403.01475cs.LGcs.AIcs.SI
收藏

基于有向邻域注意力的异配图表示学习

Representation Learning on Heterophilic Graph with Directional Neighborhood Attention

McGill University(麦吉尔大学);Mila - Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所)

Qincheng Lu, Jiaqi Zhu, Sitao Luan, Xiao-Wen Chang

AI总结:

针对 GAT 难以捕获异配图长程与全局信息的问题,提出 DGAT,利用新型 Laplacian、邻居剪枝/补边及全局有向注意力增强表示学习,并在多数基准上超过 SOTA。

摘要:

Graph Attention Network(GAT,图注意力网络)是最流行的 Graph Neural Network(GNN,图神经网络)架构之一,它采用注意力机制学习边权重,并已在多种应用中展现出良好性能。然而,由于其仅融合来自直接邻域的信息,缺乏捕获长程和全局图信息的能力,导致在某些数据集上性能不佳,尤其是在异配图上。为解决这一局限,本文提出 Directional Graph Attention Network(DGAT,有向图注意力网络)。DGAT 能够将基于特征的注意力与从图拓扑中提取的全局有向信息相结合。为此,论文提出一类新的 Laplacian 矩阵,并可证明其能够缩短节点间的扩散距离。基于该新 Laplacian,提出拓扑引导的邻居剪枝和边添加机制,以去除噪声并捕获有用的长程邻域信息。此外,设计了全局有向注意力,以实现具备拓扑感知能力的信息传播。在真实世界基准和合成数据集上的实验也验证了所提 DGAT 相对于基线 GAT 的优越性。它还在 7 个真实世界基准数据集中的 6 个上优于最先进(SOTA)模型。

英文摘要:

Graph Attention Network (GAT) is one of the most popular Graph Neural Network (GNN) architecture, which employs the attention mechanism to learn edge weights and has demonstrated promising performance in various applications. However, since it only incorporates information from immediate neighborhood, it lacks the ability to capture long-range and global graph information, leading to unsatisfactory performance on some datasets, particularly on heterophilic graphs. To address this limitation, we propose the Directional Graph Attention Network (DGAT) in this paper. DGAT is able to combine the feature-based attention with the global directional information extracted from the graph topology. To this end, a new class of Laplacian matrices is proposed which can provably reduce the diffusion distance between nodes. Based on the new Laplacian, topology-guided neighbour pruning and edge adding mechanisms are proposed to remove the noisy and capture the helpful long-range neighborhood information. Besides, a global directional attention is designed to enable a topological-aware information propagation. The superiority of the proposed DGAT over the baseline GAT has also been verified through experiments on real-world benchmarks and synthetic data sets. It also outperforms the state-of-the-art (SOTA) models on 6 out of 7 real-world benchmark datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑