arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.30786cs.LG
收藏

AbstainGNN:教会图神经网络在图分类中弃权

AbstainGNN: Teaching Graph Neural Networks to Abstain for Graph Classification

Institute of Information Engineering, Chinese Academy of Sciences(信息工程研究所,中国科学院);School of Mathematics and Statistics, Shandong University(数学与统计学学院,山东大学);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(数学与系统科学学院,中国科学院);School of Information and Intelligent Science, Donghua University(信息与智能科学学院,东华大学);TikTok, ByteDance Inc.(TikTok,字节跳动公司);School of Cyber Science and Engineering, Wuhan University(网络安全与工程学院,武汉大学);Cyberspace Institute of Advanced Technology, Guangzhou University(空域技术高级研究所,广州大学);Griffith University(格里菲斯大学)

Xixun Lin, Zhiheng Zhou, Zhengyin Zhang, Yancheng Chen, Shuai Zhang, Ge Zhang, Shichao Zhu, Lixin Zou, Chuan Zhou, Peng Zhang, Shirui Pan, Yanan Cao

AI总结:

提出AbstainGNN框架,通过理论驱动的弃权机制让GNN在不确定时拒绝预测,避免错误决策,并基于PAC-Bayes理论优化分类与弃权权衡。

摘要:

图分类是图数据挖掘中的核心任务,具有广泛的现实应用。图神经网络的最新进展显著提升了图分类的性能。然而,现有的GNN即使在高度不确定性或未知条件下也通常被迫做出预测,导致不可靠的决策,特别是在安全关键场景中会严重影响下游任务。为了解决这一关键限制,我们提出了AbstainGNN,一种新颖且理论驱动的带弃权图分类框架,使GNN能够拒绝不确定的预测,而不是产生错误的决策。具体来说,AbstainGNN显式地建模了预测函数和弃权函数,从而有效利用图结构信息。此外,与现有的启发式弃权方法不同,我们从PAC-Bayesian泛化角度理论刻画了分类错误与拒绝成本之间的权衡,并推导出用于模型优化的统一学习目标。在此理论洞察的指导下,我们进一步开发了一种高效的两阶段训练策略,包括预测函数预热和弃权函数校准。在五个基准数据集上的大量实验表明,AbstainGNN优于现有的弃权方法,在相同拒绝率下实现了更优的分类性能。

英文摘要:

Graph classification is a core task in graph data mining with widespread real-world applications. Recent advances in graph neural networks (GNNs) have led to substantial performance improvements for graph classification. However, existing GNNs are typically forced to make predictions even under high uncertainty or unknown conditions, resulting in unreliable decisions that can severely impact downstream tasks, particularly in safety-critical scenarios. To address this critical limitation, we propose AbstainGNN, a novel and theory-driven framework for graph classification with abstention, which enables GNNs to reject uncertain predictions instead of producing incorrect decisions. Specifically, AbstainGNN explicitly models both the predictive function and the abstention function, allowing for effective utilization of graph structural information. Moreover, unlike existing heuristic abstention methods, we theoretically characterize the trade-off between classification errors and rejection costs from a PAC-Bayesian generalization perspective, and derive a unified learning objective for model optimization. Guided by this theoretical insight, we further develop an efficient two-stage training strategy consisting of predictive function warm-start and abstention function calibration. Extensive experiments on five benchmark datasets show that AbstainGNN outperforms existing abstention methods, achieving superior classification performance under the same rejection rates.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑