arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.13264cs.LGcs.AI
收藏

你是AllSet:超图神经网络的多集函数框架

You are AllSet: A Multiset Function Framework for Hypergraph Neural Networks

University of Illinois, Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Eli Chien, Chao Pan, Jianhao Peng, Olgica Milenkovic

摘要:

超图被用来模拟代理之间的高阶交互,并且存在许多实际相关的超图数据集实例。为了能够有效地处理超图结构的数据,已经提出了几个超图神经网络平台,用于学习超图的属性和结构,特别关注节点分类。然而,几乎所有现有的方法都使用启发式传播规则,并在许多数据集上提供次优性能。我们提出了AllSet,一种新的超图神经网络范式,它代表了(超)图神经网络的一个高度通用的框架,并首次将超图神经网络层实现为两个多集函数的组合,可以有效地学习每个任务和每个数据集。此外,AllSet利用了超图神经网络与多集函数深度学习的最新进展之间的新联系。特别是,所提出的架构利用深集和集Transformer架构,允许显着的建模灵活性,并提供高的表达能力。为了评估AllSet的性能,我们进行了迄今为止最广泛的实验,涉及十个已知的基准数据集和三个新策划的数据集,这些数据集代表了超图节点分类的重大挑战。结果表明,AllSet具有独特的能力,在测试数据集上始终匹配或优于所有其他超图神经网络。

英文摘要:

Hypergraphs are used to model higher-order interactions amongst agents and there exist many practically relevant instances of hypergraph datasets. To enable efficient processing of hypergraph-structured data, several hypergraph neural network platforms have been proposed for learning hypergraph properties and structure, with a special focus on node classification. However, almost all existing methods use heuristic propagation rules and offer suboptimal performance on many datasets. We propose AllSet, a new hypergraph neural network paradigm that represents a highly general framework for (hyper)graph neural networks and for the first time implements hypergraph neural network layers as compositions of two multiset functions that can be efficiently learned for each task and each dataset. Furthermore, AllSet draws on new connections between hypergraph neural networks and recent advances in deep learning of multiset functions. In particular, the proposed architecture utilizes Deep Sets and Set Transformer architectures that allow for significant modeling flexibility and offer high expressive power. To evaluate the performance of AllSet, we conduct the most extensive experiments to date involving ten known benchmarking datasets and three newly curated datasets that represent significant challenges for hypergraph node classification. The results demonstrate that AllSet has the unique ability to consistently either match or outperform all other hypergraph neural networks across the tested datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑