arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.12840cs.LG
收藏

AdaGNN:具有自适应频率响应滤波器的图神经网络

AdaGNN: Graph Neural Networks with Adaptive Frequency Response Filter

University of Virginia(弗吉尼亚大学);Arizona State University(亚利桑那州立大学);Army Research Laboratory(陆军研究实验室)

Yushun Dong, Kaize Ding, Brian Jalaian, Shuiwang Ji, Jundong Li

摘要:

图神经网络最近已经成为各种高影响力图分析问题的流行范例。现有的努力主要可分为基于光谱和基于空间的方法。前者的主要挑战是找到一个合适的图滤波器,从输入信号中提取判别信息进行学习。最近,为了实现更好的图过滤器,进行了无数的探索,例如,图卷积网络(GCN),它利用切比雪夫多项式截断来寻求图滤波器的近似,并桥接这两类方法。然而,最近的研究表明,GCN及其变体基本上采用固定的低通滤波器来执行信息去噪。因此,它们的学习能力相当有限,并且可能在更深层过度平滑节点表示。为了解决这些问题,我们开发了一个新的图神经网络框架AdaGNN与一个精心设计的自适应频率响应滤波器。AdaGNN的核心是利用一个简单但优雅的可训练滤波器,该滤波器跨越多个层,以捕获不同频率分量对节点表示学习的不同重要性。不同特征通道之间的固有差异也被滤波器很好地捕获。因此,它使AdaGNN具有更强的表现力,并自然消除了过度平滑的问题。我们在各种基准数据集上实证验证了所提出的框架的有效性。理论分析也提供了所提出的AdaGNN的优越性。AdaGNN的开源实现可以在这里找到:https://github.com/yushundong/AdaGNN。

英文摘要:

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former is to find an appropriate graph filter to distill discriminative information from input signals for learning. Recently, myriads of explorations are made to achieve better graph filters, e.g., Graph Convolutional Network (GCN), which leverages Chebyshev polynomial truncation to seek an approximation of graph filters and bridge these two families of methods. Nevertheless, it has been shown in recent studies that GCN and its variants are essentially employing fixed low-pass filters to perform information denoising. Thus their learning capability is rather limited and may over-smooth node representations at deeper layers. To tackle these problems, we develop a novel graph neural network framework AdaGNN with a well-designed adaptive frequency response filter. At its core, AdaGNN leverages a simple but elegant trainable filter that spans across multiple layers to capture the varying importance of different frequency components for node representation learning. The inherent differences among different feature channels are also well captured by the filter. As such, it empowers AdaGNN with stronger expressiveness and naturally alleviates the over-smoothing problem. We empirically validate the effectiveness of the proposed framework on various benchmark datasets. Theoretical analysis is also provided to show the superiority of the proposed AdaGNN. The open-source implementation of AdaGNN can be found here: https://github.com/yushundong/AdaGNN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑