arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.08583cs.LG
收藏

GrassNet:状态空间模型与图神经网络的结合

GrassNet: State Space Model Meets Graph Neural Network

School of Computer Science and Technology(计算机科学与技术学院);Beijing Jiaotong University(北京交通大学);Department of Computer Science(计算机科学系);Stony Brook University(石溪大学)

Gongpei Zhao, Tao Wang, Yi Jin, Congyan Lang, Yidong Li, Haibin Ling

AI总结:

针对传统谱图神经网络多项式滤波器的低阶截断与图谱整体建模不足的问题,提出引入结构化状态空间模型的GrassNet,可学习任意图谱滤波器,理论表达力更强,在9个基准上实现了更优性能。

摘要:

设计谱卷积网络是图学习领域的一项艰巨任务。在传统谱图神经网络(GNNs)中,基于多项式的方法通常通过拉普拉斯矩阵来设计滤波器。然而在实际应用中,这些多项式方法存在固有局限性,主要源于多项式滤波器的低阶截断以及对图谱缺乏整体建模。这导致现有谱方法在真实世界图数据上表现不佳,尤其是在谱高度集中或包含大量数值相同的值时,因为它们往往会对相同频率的信号施加完全相同的调制。为解决这些问题,本文提出了图状态空间网络(GrassNet)——一种具备理论支撑的新型图神经网络,它为设计和学习任意图谱滤波器提供了简单且有效的方案。具体而言,我们的GrassNet引入结构化状态空间模型(SSMs)来建模不同频率下图信号的相关性,并为图谱中的每个频率推导了独特的校正方式。据我们所知,本研究首次将SSMs用于GNN谱滤波器设计,且在理论上比多项式滤波器具备更强的表达能力。在9个公开基准上的大量实验表明,GrassNet在真实世界图建模任务中取得了优异性能。

英文摘要:

Designing spectral convolutional networks is a formidable task in graph learning. In traditional spectral graph neural networks (GNNs), polynomial-based methods are commonly used to design filters via the Laplacian matrix. In practical applications, however, these polynomial methods encounter inherent limitations, which primarily arise from the the low-order truncation of polynomial filters and the lack of overall modeling of the graph spectrum. This leads to poor performance of existing spectral approaches on real-world graph data, especially when the spectrum is highly concentrated or contains many numerically identical values, as they tend to apply the exact same modulation to signals with the same frequencies. To overcome these issues, in this paper, we propose Graph State Space Network (GrassNet), a novel graph neural network with theoretical support that provides a simple yet effective scheme for designing and learning arbitrary graph spectral filters. In particular, our GrassNet introduces structured state space models (SSMs) to model the correlations of graph signals at different frequencies and derives a unique rectification for each frequency in the graph spectrum. To the best of our knowledge, our work is the first to employ SSMs for the design of GNN spectral filters, and it theoretically offers greater expressive power compared with polynomial filters. Extensive experiments on nine public benchmarks reveal that GrassNet achieves superior performance in real-world graph modeling tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑