arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.06380stat.MLcs.DScs.LG
收藏

指针图网络

Pointer Graph Networks

DeepMind(深度思维)

Petar Veličković, Lars Buesing, Matthew C. Overlan, Razvan Pascanu, Oriol Vinyals, Charles Blundell

摘要:

图神经网络(GNN)通常应用于假定预先已知的静态图。这种静态输入结构通常纯粹是由机器学习从业者的洞察力所告知的,并且对于GNN正在解决的实际任务可能不是最佳的。在缺乏可靠的领域专业知识的情况下,人们可能会诉诸于推断潜在图的结构,这通常是困难的,因为可能的图的巨大搜索空间。在这里,我们介绍了指针图网络(PGN),它可以用额外的推断边来增强集合或图形,以提高模型的泛化能力。PGN允许每个节点动态地指向另一个节点,然后通过这些指针传递消息。这种自适应图结构的稀疏性使得学习易于处理,同时仍然具有足够的表达能力来模拟复杂的算法。关键是,指向机制直接监督对经典数据结构的长期操作序列进行建模,并结合理论计算机科学中有用的结构归纳偏差。定性,我们证明了PGN可以学习基于指针的数据结构,即不相交的集合工会和链接/切割树的并行化变体。PGN在动态图连接任务中将分布外的测试输入推广到5倍大的测试输入,性能优于不受限制的GNN和Deep Set。

英文摘要:

Graph neural networks (GNNs) are typically applied to static graphs that are assumed to be known upfront. This static input structure is often informed purely by insight of the machine learning practitioner, and might not be optimal for the actual task the GNN is solving. In absence of reliable domain expertise, one might resort to inferring the latent graph structure, which is often difficult due to the vast search space of possible graphs. Here we introduce Pointer Graph Networks (PGNs) which augment sets or graphs with additional inferred edges for improved model generalisation ability. PGNs allow each node to dynamically point to another node, followed by message passing over these pointers. The sparsity of this adaptable graph structure makes learning tractable while still being sufficiently expressive to simulate complex algorithms. Critically, the pointing mechanism is directly supervised to model long-term sequences of operations on classical data structures, incorporating useful structural inductive biases from theoretical computer science. Qualitatively, we demonstrate that PGNs can learn parallelisable variants of pointer-based data structures, namely disjoint set unions and link/cut trees. PGNs generalise out-of-distribution to 5x larger test inputs on dynamic graph connectivity tasks, outperforming unrestricted GNNs and Deep Sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑