GrAMME:使用多层图注意力模型的半监督学习
GrAMME: Semi-Supervised Learning using Multi-layered Graph Attention Models
摘要:
由于多视图信息源的存在,现代数据分析管道变得越来越复杂。虽然图在建模复杂关系方面是有效的,但在许多情况下,单个图很少足以简洁地表示所有交互,因此多层图已经变得流行。虽然这会导致更丰富的表示,但从单图情况扩展解决方案并不简单。因此,有一个强烈的需要,新的解决方案来解决经典的问题,如节点分类,在多层的情况下。在本文中,我们考虑了多层图的半监督学习问题。虽然深度网络嵌入,例如DeepWalk,被广泛用于社区发现,但我们认为,使用图神经网络的随机节点属性的特征学习可能更有效。为此,我们建议使用注意力模型进行有效的特征学习,并开发了两种新的架构,GrAMME-SG和GrAMME-Fusion,它们利用层间依赖关系来构建多层图嵌入。通过对几个基准数据集的实证研究,我们评估了所提出的方法,并与最先进的网络嵌入策略相比,表现出显着的性能改进。结果还表明,即使在显式节点属性不可用的情况下,使用简单的随机特征也是一种有效的选择。
英文摘要:
Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to succinctly represent all interactions, and hence multi-layered graphs have become popular. Though this leads to richer representations, extending solutions from the single-graph case is not straightforward. Consequently, there is a strong need for novel solutions to solve classical problems, such as node classification, in the multi-layered case. In this paper, we consider the problem of semi-supervised learning with multi-layered graphs. Though deep network embeddings, e.g. DeepWalk, are widely adopted for community discovery, we argue that feature learning with random node attributes, using graph neural networks, can be more effective. To this end, we propose to use attention models for effective feature learning, and develop two novel architectures, GrAMME-SG and GrAMME-Fusion, that exploit the inter-layer dependencies for building multi-layered graph embeddings. Using empirical studies on several benchmark datasets, we evaluate the proposed approaches and demonstrate significant performance improvements in comparison to state-of-the-art network embedding strategies. The results also show that using simple random features is an effective choice, even in cases where explicit node attributes are not available.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。