arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2204.04510cs.LGcs.AIcs.SI
收藏

将子图翻译为节点使简单GNN在子图表示学习中强大且高效

Translating Subgraphs to Nodes Makes Simple GNNs Strong and Efficient for Subgraph Representation Learning

School of Computing, KAIST(韩国科学技术院计算机学院)

Dongkwan Kim, Alice Oh

AI总结:

提出子图到节点(S2N)翻译方法,将子图转化为节点构建新图,降低内存与计算成本,捕获局部与全局结构,在八个基准上处理样本量提升183-711倍且性能更优。

摘要:

子图表示学习已成为一个重要问题,但默认情况下,它是在大型全局图上使用专门的图神经网络来处理的。这些模型需要大量的内存和计算资源,但在建模子图的层次结构方面面临挑战。在本文中,我们提出了子图到节点(S2N)翻译,一种用于学习子图表示的新颖公式。具体来说,给定全局图中的一组子图,我们通过将子图粗略地转换为节点来构建一个新图。通过理论和实证证据,S2N不仅显著降低了与最先进模型相比的内存和计算成本,而且通过捕获子图的局部和全局结构,性能优于它们。通过利用图粗化方法,即使在子图不足的数据稀缺设置中,我们的方法也优于基线。我们在八个基准上的实验表明,使用S2N翻译进行微调的模型可以处理比最先进模型多183至711倍的子图样本,同时达到更好或相似的性能水平。

英文摘要:

Subgraph representation learning has emerged as an important problem, but it is by default approached with specialized graph neural networks on a large global graph. These models demand extensive memory and computational resources but challenge modeling hierarchical structures of subgraphs. In this paper, we propose Subgraph-To-Node (S2N) translation, a novel formulation for learning representations of subgraphs. Specifically, given a set of subgraphs in the global graph, we construct a new graph by coarsely transforming subgraphs into nodes. Demonstrating both theoretical and empirical evidence, S2N not only significantly reduces memory and computational costs compared to state-of-the-art models but also outperforms them by capturing both local and global structures of the subgraph. By leveraging graph coarsening methods, our method outperforms baselines even in a data-scarce setting with insufficient subgraphs. Our experiments on eight benchmarks demonstrate that fined-tuned models with S2N translation can process 183 -- 711 times more subgraph samples than state-of-the-art models at a better or similar performance level.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑