arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.11944cs.LGcs.AI
收藏

有效电阻重排:一种简单的拓扑修正以解决过压缩问题

Effective Resistance Rewiring: A Simple Topological Correction for Over-Squashing

Bertran Miquel-Oliver, Manel Gil-Sorribes, Victor Guallar, Alexis Molina

AI总结:

本文提出Effective Resistance Rewiring方法,通过有效电阻检测结构瓶颈,改善图神经网络的信息传播与表示多样性,同时结合归一化技术优化深度模型的性能。

摘要:

图神经网络因过压缩问题难以捕捉长距离依赖关系,其中信息必须通过少量的结构瓶颈传递。尽管最近的重排方法试图缓解这一限制,但许多方法依赖于局部标准如曲率,这可能会忽略全局连接约束,这些约束限制信息流动。我们引入了有效电阻重排(ERR),一种简单的拓扑修正策略,利用有效电阻作为全局信号来检测结构瓶颈。ERR通过在电阻最大的节点对之间添加边,同时移除电阻最小的边,从而加强弱通信路径,同时在固定边预算下控制图的稠密程度。该过程除了重排预算外无需其他参数,仅依赖于一个全局度量,聚合所有节点对之间的路径。除了与GCN模型的预测性能之外,我们还分析了重排对信息传播的影响。通过跟踪不同层之间节点嵌入的余弦相似度,我们研究了初始节点特征与学习表示之间的关系如何在信息传递过程中演变,比较有重排和无重排的图。这种分析有助于确定改进是否源于更好的长距离通信,而不是表示几何的变化。在同质和异质图上进行的实验,包括使用DirGCN的有向设置,揭示了过压缩和过度平滑之间的权衡,其中过度平滑对应于各层之间表示多样性损失。由电阻引导的重排提高了连通性和信号传播,但可能在深度模型中加速表示混合。将ERR与归一化技术如PairNorm结合可以稳定这种权衡并提高性能。

英文摘要:

Graph Neural Networks struggle to capture long-range dependencies due to over-squashing, where information from exponentially growing neighborhoods must pass through a small number of structural bottlenecks. While recent rewiring methods attempt to alleviate this limitation, many rely on local criteria such as curvature, which can overlook global connectivity constraints that restrict information flow. We introduce Effective Resistance Rewiring (ERR), a simple topology correction strategy that uses effective resistance as a global signal to detect structural bottlenecks. ERR iteratively adds edges between node pairs with the largest resistance while removing edges with minimal resistance, strengthening weak communication pathways while controlling graph densification under a fixed edge budget. The procedure is parameter-free beyond the rewiring budget and relies on a single global measure aggregating all paths between node pairs. Beyond predictive performance with GCN models, we analyze how rewiring affects message propagation. By tracking cosine similarity between node embeddings across layers, we examine how the relationship between initial node features and learned representations evolves during message passing, comparing graphs with and without rewiring. This analysis helps determine whether improvements arise from better long-range communication rather than changes in embedding geometry. Experiments on homophilic and heterophilic graphs, including directed settings with DirGCN, reveal a trade-off between over-squashing and oversmoothing, where oversmoothing corresponds to the loss of representation diversity across layers. Resistance-guided rewiring improves connectivity and signal propagation but can accelerate representation mixing in deep models. Combining ERR with normalization techniques such as PairNorm stabilizes this trade-off and improves performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑