arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1903.07293cs.SI
收藏

异构图注意力网络

Heterogeneous Graph Attention Network

Xiao Wang, Houye Ji, Chuan Shi, Bai Wang, Peng Cui, P. Yu, Yanfang Ye

摘要:

图神经网络作为一种基于深度学习的强大的图表示技术,表现出了优越的性能,引起了相当大的研究兴趣。然而,对于包含不同类型节点和链接的异构图,图神经网络没有充分考虑这一点。异构图的异构性和丰富的语义信息给设计面向异构图的图神经网络带来了很大的挑战。最近,深度学习最令人兴奋的进展之一是注意力机制,它的巨大潜力已经在各个领域得到了很好的展示。本文首先提出了一种基于层次注意力的异构图神经网络,包括节点级注意力和语义级注意力。具体来说,节点级注意力旨在学习节点与其基于元路径的邻居之间的重要性,而语义级注意力能够学习不同元路径的重要性。通过从节点级和语义级注意力中学习重要性,可以充分考虑节点和元路径的重要性。然后,该模型可以生成节点嵌入聚合功能从元路径为基础的邻居在一个层次的方式。在三个真实世界的异构图上进行的大量实验结果不仅显示了我们提出的模型在最先进技术上的优越性能,而且还表明了它对图分析的潜在良好的可解释性。

英文摘要:

Graph neural network, as a powerful graph representation technique based on deep learning, has shown superior performance and attracted considerable research interest. However, it has not been fully considered in graph neural network for heterogeneous graph which contains different types of nodes and links. The heterogeneity and rich semantic information bring great challenges for designing a graph neural network for heterogeneous graph. Recently, one of the most exciting advancements in deep learning is the attention mechanism, whose great potential has been well demonstrated in various areas. In this paper, we first propose a novel heterogeneous graph neural network based on the hierarchical attention, including node-level and semantic-level attentions. Specifically, the node-level attention aims to learn the importance between a node and its metapath based neighbors, while the semantic-level attention is able to learn the importance of different meta-paths. With the learned importance from both node-level and semantic-level attention, the importance of node and meta-path can be fully considered. Then the proposed model can generate node embedding by aggregating features from meta-path based neighbors in a hierarchical manner. Extensive experimental results on three real-world heterogeneous graphs not only show the superior performance of our proposed model over the state-of-the-arts, but also demonstrate its potentially good interpretability for graph analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑