GSR-GNN:电路图上深度GNN的训练加速与内存节省框架
GSR-GNN: Training Acceleration and Memory-Saving Framework of Deep GNNs on Circuit Graph
AI总结:
本文提出GSR-GNN框架,通过可逆残差模块和分组稀疏非线性操作,实现深度GNN在大规模电路图上的高效训练,达到87.2%的内存节省和30倍以上的加速,同时保持相关质量指标的稳定。
摘要:
图神经网络(GNNs)在电路分析中展现出强大潜力,但在扩展到现代大规模电路图时受到GPU内存和训练成本的限制,尤其是深度模型。我们重新审视深度GNNs用于电路图,并展示可训练的GNNs显著优于浅层架构,推动了高效、领域特定的训练框架。我们提出组内稀疏可逆GNN(GSR-GNN),使训练GNNs具有多达数百层的同时减少计算和内存开销。GSR-GNN整合了可逆残差模块和分组稀疏非线性操作,压缩节点嵌入而不牺牲任务相关的信息,并采用优化的执行管道消除碎片化激活存储和减少数据移动。在采样电路图上,GSR-GNN实现了高达87.2%的峰值内存减少和超过30倍的训练加速,同时相关质量指标的降级可忽略不计,使深度GNNs在大规模EDA工作负载中成为可行方案。
英文摘要:
Graph Neural Networks (GNNs) show strong promise for circuit analysis, but scaling to modern large-scale circuit graphs is limited by GPU memory and training cost, especially for deep models. We revisit deep GNNs for circuit graphs and show that, when trainable, they significantly outperform shallow architectures, motivating an efficient, domain-specific training framework. We propose Grouped-Sparse-Reversible GNN (GSR-GNN), which enables training GNNs with up to hundreds of layers while reducing both compute and memory overhead. GSR-GNN integrates reversible residual modules with a group-wise sparse nonlinear operator that compresses node embeddings without sacrificing task-relevant information, and employs an optimized execution pipeline to eliminate fragmented activation storage and reduce data movement. On sampled circuit graphs, GSR-GNN achieves up to 87.2\% peak memory reduction and over 30$\times$ training speedup with negligible degradation in correlation-based quality metrics, making deep GNNs practical for large-scale EDA workloads.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。