arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.13878cs.LGeess.SP
收藏

图神经网络的泛化对模型失配具有鲁棒性

Generalization of Graph Neural Networks is Robust to Model Mismatch

University of Pennsylvania(宾夕法尼亚大学);Massachusetts Institute of Technology(麻省理工学院)

Zhiyang Wang, Juan Cervino, Alejandro Ribeiro

AI总结:

本文分析几何图GNN在训练与测试流形模型失配下的泛化界,证明其对节点特征和边扰动具有鲁棒性,并揭示节点数、流形维度、失配程度及高频分辨能力的影响。

摘要:

图神经网络(GNN)凭借其泛化能力,已在多种任务中证明了有效性。然而,当前对GNN泛化的分析依赖于训练数据与测试数据独立同分布(i.i.d.)这一假设。这给生成测试数据时存在模型失配的情形带来了限制。本文考察运行于由流形模型生成的几何图上的GNN,明确聚焦于生成训练数据与测试数据的流形模型之间存在失配的场景。我们的分析揭示了在这种模型失配存在时GNN泛化的鲁棒性。这表明,在由某一流形生成的图上训练的GNN,仍能很好地泛化到由失配流形生成的未见节点和图。我们将这种失配归因于所生成图内的节点特征扰动和边扰动。研究结果表明,泛化差距随训练图中节点数量的增加而减小,但随流形维度增大以及失配程度增大而增加。重要的是,我们观察到在面临模型失配时,GNN的泛化与区分高频成分的能力之间存在一种权衡。该分析最重要的实际意义,是为设计对模型失配鲁棒、可泛化的GNN滤波器提供启示。我们在多个真实世界数据集上通过实验验证了理论发现。

英文摘要:

Graph neural networks (GNNs) have demonstrated their effectiveness in various tasks supported by their generalization capabilities. However, the current analysis of GNN generalization relies on the assumption that training and testing data are independent and identically distributed (i.i.d). This imposes limitations on the cases where a model mismatch exists when generating testing data. In this paper, we examine GNNs that operate on geometric graphs generated from manifold models, explicitly focusing on scenarios where there is a mismatch between manifold models generating training and testing data. Our analysis reveals the robustness of the GNN generalization in the presence of such model mismatch. This indicates that GNNs trained on graphs generated from a manifold can still generalize well to unseen nodes and graphs generated from a mismatched manifold. We attribute this mismatch to both node feature perturbations and edge perturbations within the generated graph. Our findings indicate that the generalization gap decreases as the number of nodes grows in the training graph while increasing with larger manifold dimension as well as larger mismatch. Importantly, we observe a trade-off between the generalization of GNNs and the capability to discriminate high-frequency components when facing a model mismatch. The most important practical consequence of this analysis is to shed light on the filter design of generalizable GNNs robust to model mismatch. We verify our theoretical findings with experiments on multiple real-world datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑