arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.02892cs.LGeess.SP
收藏

基于拓扑自适应边丢弃的鲁棒图神经网络

Training Robust Graph Neural Networks with Topology Adaptive Edge Dropping

University of Pennsylvania(宾夕法尼亚大学);Lehigh University(理海大学);Army Research Laboratory(陆军研究实验室)

Zhan Gao, Subhrajit Bhattacharya, Leiming Zhang, Rick S. Blum, Alejandro Ribeiro, Brian M. Sadler

摘要:

图神经网络(GNN)是利用图结构信息来对来自网络数据的表示进行建模的处理架构。尽管GNN取得了成功,但在有限的训练数据下,GNN的泛化性能不佳,称为过拟合。本文提出了拓扑自适应边缘丢弃(TADropEdge)方法作为一种自适应数据增强技术,以提高泛化性能和学习鲁棒GNN模型。我们首先明确分析随机边缘丢弃如何在训练期间增加数据多样性,同时指示i.i.d.边缘丢弃不考虑图形结构信息,并且可能导致噪声增强数据降低性能。为了克服这个问题,我们认为图的连通性作为捕捉图的拓扑结构的关键属性。TADropEdge将此因素纳入随机边丢弃中,使得边丢弃的子图保持与底层图相似的拓扑结构,从而产生更令人满意的数据增强。特别地,TADropEdge首先利用图谱为图边缘分配适当的权重,这表示它们对于建立图连通性的关键性。然后,它规范化的边缘权重和删除图形边缘自适应的基础上,他们的规范化的权重。除了提高泛化性能外,TADropEdge还降低了有效训练的方差,可以作为一种通用方法模块应用于不同的GNN模型。在真实数据集和人工数据集上的实验验证了该方法的有效性。

英文摘要:

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited training data, referred to as over-fitting. This paper proposes Topology Adaptive Edge Dropping (TADropEdge) method as an adaptive data augmentation technique to improve generalization performance and learn robust GNN models. We start by explicitly analyzing how random edge dropping increases the data diversity during training, while indicating i.i.d. edge dropping does not account for graph structural information and could result in noisy augmented data degrading performance. To overcome this issue, we consider graph connectivity as the key property that captures graph topology. TADropEdge incorporates this factor into random edge dropping such that the edge-dropped subgraphs maintain similar topology as the underlying graph, yielding more satisfactory data augmentation. In particular, TADropEdge first leverages the graph spectrum to assign proper weights to graph edges, which represent their criticality for establishing the graph connectivity. It then normalizes the edge weights and drops graph edges adaptively based on their normalized weights. Besides improving generalization performance, TADropEdge reduces variance for efficient training and can be applied as a generic method modular to different GNN models. Intensive experiments on real-life and synthetic datasets corroborate theory and verify the effectiveness of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑