arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.04895cs.LGcs.AI
收藏

不传播反而更好:理解有符号图神经网络中的边不确定性与过平滑

Better Not to Propagate: Understanding Edge Uncertainty and Over-smoothing in Signed Graph Neural Networks

Samsung SDS(三星SDS);KAIST(韩国科学技术院);Seoul National University(首尔国立大学);Korea Institute of Energy Technology(韩国能源技术研究院)

Yoonhyuk Choi, Jiho Choi, Taewook Ko, Chong-Kwon Kim

AI总结:

针对现有有符号图神经网络传播方案错误率固定、易过平滑的问题,提出结合同质性与边错误率估计、动态选择阻塞/有符号传播的方法,证明高边错误率下阻塞传播更有效,可提升异/同质性图性能。

摘要:

传统图神经网络(GNNs)依赖网络同质性,在许多现实世界的异质性场景中会因过平滑导致性能下降。近期研究分析了消息传递(MP)后的平滑效应(可分离性),其取决于节点特征的期望。围绕可分离性增益,这些研究为正消息传递、有符号消息传递和阻塞消息传递等各类传播方案引发的过平滑提供了理论基础。更近的研究通过扩展这些定理,提出了多类别下有符号传播的改进方案。但现有工作假设所有传播方案的错误率都是固定的,未能正确研究这一现象。为解决该问题,我们提出了一种估计同质性和边错误率的新方法,该方法在训练过程中集成了阻塞传播与有符号传播的动态选择机制。我们的理论分析(辅以大量实验)表明,在边错误率较高的情况下,阻塞消息传递比有符号传播更有效,能同时提升同质性图和异质性图的性能。

英文摘要:

Traditional Graph Neural Networks (GNNs) rely on network homophily, which can lead to performance degradation due to over-smoothing in many real-world heterophily scenarios. Recent studies analyze the smoothing effect (separability) after message-passing (MP), depending on the expectation of node features. Regarding separability gain, they provided theoretical backgrounds on over-smoothing caused by various propagation schemes, including positive, signed, and blocked MPs. More recently, by extending these theorems, some works have suggested improvements in signed propagation under multiple classes. However, prior works assume that the error ratio of all propagation schemes is fixed, failing to investigate this phenomenon correctly. To solve this problem, we propose a novel method for estimating homophily and edge error ratio, integrated with dynamic selection between blocked and signed propagation during training. Our theoretical analysis, supported by extensive experiments, demonstrates that blocking MP can be more effective than signed propagation under high edge error ratios, improving the performance in both homophilic and heterophilic graphs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑