arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.01099cs.LG
收藏

移位鲁棒GNN:克服局部图训练数据的局限性

Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Data

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Google Research(谷歌研究院)

Qi Zhu, Natalia Ponomareva, Jiawei Han, Bryan Perozzi

摘要:

最近,人们对为半监督学习任务设计图神经网络(GNN)的兴趣激增。不幸的是,这项工作假设标记用于训练的节点是随机均匀选择的(即是IID样本)。然而,在许多现实世界的场景中,为图节点收集标签既昂贵又固有地有偏见-因此无法满足此假设。当这种情况发生时,GNN可能会受到不良的泛化影响,这是由于对训练数据中存在的多余数据进行过拟合。在这项工作中,我们提出了一种方法,移位鲁棒GNN(SR-GNN),旨在占有偏见的训练数据和图的真实推理分布之间的分布差异。SR-GNN调整GNN模型,以适应具有用于训练的标签的节点与数据集的其余部分之间存在的分布变化。我们在半监督学习的常见GNN基准数据集上使用有偏训练数据集进行的各种实验中说明了SR-GNN的有效性,其中我们看到SR-GNN在准确性方面优于其他GNN基线,消除了至少(~40%)由有偏训练数据引入的负面影响。在我们考虑的最大数据集ogb-arxiv上,我们观察到比基线有2%的绝对改善,并减少了30%的负面影响。

英文摘要:

There has been a recent surge of interest in designing Graph Neural Networks (GNNs) for semi-supervised learning tasks. Unfortunately this work has assumed that the nodes labeled for use in training were selected uniformly at random (i.e. are an IID sample). However in many real world scenarios gathering labels for graph nodes is both expensive and inherently biased -- so this assumption can not be met. GNNs can suffer poor generalization when this occurs, by overfitting to superfluous regularities present in the training data. In this work we present a method, Shift-Robust GNN (SR-GNN), designed to account for distributional differences between biased training data and the graph's true inference distribution. SR-GNN adapts GNN models for the presence of distributional shifts between the nodes which have had labels provided for training and the rest of the dataset. We illustrate the effectiveness of SR-GNN in a variety of experiments with biased training datasets on common GNN benchmark datasets for semi-supervised learning, where we see that SR-GNN outperforms other GNN baselines by accuracy, eliminating at least (~40%) of the negative effects introduced by biased training data. On the largest dataset we consider, ogb-arxiv, we observe an 2% absolute improvement over the baseline and reduce 30% of the negative effects.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑