arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.11198cs.LGstat.ML
收藏

SIGN:可扩展的初始图神经网络

SIGN: Scalable Inception Graph Neural Networks

Twitter(推特);Imperial College London(帝国理工学院)

Fabrizio Frasca, Emanuele Rossi, Davide Eynard, Ben Chamberlain, Michael Bronstein, Federico Monti

摘要:

图表示学习最近已被应用于从计算机图形和化学到高能物理和社交媒体的广泛问题。图神经网络的流行在学术界和工业界都引发了人们对开发扩展到非常大的图(如Facebook或Twitter社交网络)的方法的兴趣。在大多数这些方法中,通过在训练时保留节点邻居或子图的子集的采样策略来减轻计算成本。在本文中,我们提出了一种新的、高效的、可扩展的图深度学习架构,该架构通过使用不同大小的图卷积滤波器来回避对图采样的需求,这些滤波器可以进行高效的预计算,从而实现极快的训练和推理。我们的架构允许使用不同的局部图运算符(例如,图案诱导的邻接矩阵或个性化页面排名扩散矩阵),以最好地适应手头的任务。我们对各种开放基准进行了广泛的实验评估,并表明我们的方法与其他最先进的架构相比具有竞争力,同时需要一小部分的训练和推理时间。此外,我们在ogbn-papers 100 M上获得了最先进的结果,ogbn-papers 100 M是最大的公共图数据集,拥有超过1.1亿个节点和15亿条边。

英文摘要:

Graph representation learning has recently been applied to a broad spectrum of problems ranging from computer graphics and chemistry to high energy physics and social media. The popularity of graph neural networks has sparked interest, both in academia and in industry, in developing methods that scale to very large graphs such as Facebook or Twitter social networks. In most of these approaches, the computational cost is alleviated by a sampling strategy retaining a subset of node neighbors or subgraphs at training time. In this paper we propose a new, efficient and scalable graph deep learning architecture which sidesteps the need for graph sampling by using graph convolutional filters of different size that are amenable to efficient precomputation, allowing extremely fast training and inference. Our architecture allows using different local graph operators (e.g. motif-induced adjacency matrices or Personalized Page Rank diffusion matrix) to best suit the task at hand. We conduct extensive experimental evaluation on various open benchmarks and show that our approach is competitive with other state-of-the-art architectures, while requiring a fraction of the training and inference time. Moreover, we obtain state-of-the-art results on ogbn-papers100M, the largest public graph dataset, with over 110 million nodes and 1.5 billion edges.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑