arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.12670cs.LGcs.AI
收藏

SMGRL:可扩展的多分辨率图表示学习

SMGRL: Scalable Multi-resolution Graph Representation Learning

McMaster University(麦克马斯特大学);Vector Institute for Artificial Intelligence(矢量人工智能研究所);University of Texas at Austin(德克萨斯大学奥斯汀分校);Apple(苹果公司)

Reza Namazi, Elahe Ghalebi, Sinead Williamson, Hamidreza Mahyar

AI总结:

针对 GCN 难捕捉长程依赖、过平滑及大图训练成本高的问题,本文提出模型无关的 SMGRL 框架,通过图粗化与自相似性学习并聚合多分辨率嵌入,在低计算成本下提升分类准确率。

摘要:

图卷积网络(GCN)使我们能够学习具有拓扑感知的节点嵌入,这些嵌入可用于分类或链接预测。然而,如果不增加额外的层,它们就无法捕捉节点之间的长程依赖关系,而增加层数又会导致过平滑以及时间和空间复杂度的上升。此外,节点之间复杂的依赖关系使小批量处理具有挑战性,从而限制了它们在大型图上的适用性。我们提出了一个可扩展的多分辨率图表示学习(Scalable Multi-resolution Graph Representation Learning,SMGRL)框架,使我们能够高效地学习多分辨率节点嵌入。我们的框架与模型无关,可应用于任何现有的 GCN 模型。我们通过仅在原始图的降维粗化版本上进行训练来大幅降低训练成本,然后利用自相似性将所得算法应用于多个分辨率。由此产生的多分辨率嵌入可以被聚合,以生成能够同时捕捉长程和短程依赖关系的高质量节点嵌入。我们的实验表明,这带来了分类准确率的提升,而不会产生高昂的计算成本。

英文摘要:

Graph convolutional networks (GCNs) allow us to learn topologically-aware node embeddings, which can be useful for classification or link prediction. However, they are unable to capture long-range dependencies between nodes without adding additional layers -- which in turn leads to over-smoothing and increased time and space complexity. Further, the complex dependencies between nodes make mini-batching challenging, limiting their applicability to large graphs. We propose a Scalable Multi-resolution Graph Representation Learning (SMGRL) framework that enables us to learn multi-resolution node embeddings efficiently. Our framework is model-agnostic and can be applied to any existing GCN model. We dramatically reduce training costs by training only on a reduced-dimension coarsening of the original graph, then exploit self-similarity to apply the resulting algorithm at multiple resolutions. The resulting multi-resolution embeddings can be aggregated to yield high-quality node embeddings that capture both long- and short-range dependencies. Our experiments show that this leads to improved classification accuracy, without incurring high computational costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑