arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.08993cs.LG
收藏

经典 GNN 是强基线:重新评估用于节点分类的 GNN

Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classification

Beihang University(北京航空航天大学);The Hong Kong Polytechnic University(香港理工大学)

Yuankai Luo, Lei Shi, Xiao-Ming Wu

AI总结:

本文通过充分调参与消融实验重新评估 GCN、GAT、GraphSAGE,发现经典 GNN 在 18 个数据集中的 17 个上可匹敌甚至超越 GT。

摘要:

Graph Transformers(GT,图 Transformer)最近已成为传统消息传递 Graph Neural Networks(GNN,图神经网络)的热门替代方案,原因在于其理论上更优的表达能力,以及在标准节点分类基准上报告的出色性能,且往往显著优于 GNN。本文中,我们进行了全面的实证分析,以重新评估三种经典 GNN 模型(GCN、GAT 和 GraphSAGE)相对于 GT 的性能。我们的发现表明,由于 GNN 的超参数配置并非最优,此前报告的 GT 优越性可能被夸大了。值得注意的是,通过轻微的超参数调优,这些经典 GNN 模型达到了最先进性能,在所考察的 18 个多样化数据集中的 17 个上,与近期 GT 的性能相当,甚至超过它们。此外,我们开展了详细的消融研究,以考察归一化、dropout、残差连接和网络深度等各种 GNN 配置对节点分类性能的影响。本研究旨在推动图机器学习领域形成更高标准的实证严谨性,鼓励对模型能力进行更准确的比较与评估。

英文摘要:

Graph Transformers (GTs) have recently emerged as popular alternatives to traditional message-passing Graph Neural Networks (GNNs), due to their theoretically superior expressiveness and impressive performance reported on standard node classification benchmarks, often significantly outperforming GNNs. In this paper, we conduct a thorough empirical analysis to reevaluate the performance of three classic GNN models (GCN, GAT, and GraphSAGE) against GTs. Our findings suggest that the previously reported superiority of GTs may have been overstated due to suboptimal hyperparameter configurations in GNNs. Remarkably, with slight hyperparameter tuning, these classic GNN models achieve state-of-the-art performance, matching or even exceeding that of recent GTs across 17 out of the 18 diverse datasets examined. Additionally, we conduct detailed ablation studies to investigate the influence of various GNN configurations, such as normalization, dropout, residual connections, and network depth, on node classification performance. Our study aims to promote a higher standard of empirical rigor in the field of graph machine learning, encouraging more accurate comparisons and evaluations of model capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑