arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.00670cs.LGcs.SI
收藏

通过预训练与归纳推理实现更快的图划分

Towards Faster Graph Partitioning via Pre-training and Inductive Inference

The Hong Kong University of Science & Technology(香港科技大学);Huawei Technologies Co., Ltd.(华为技术有限公司)

Meng Qin, Chaorui Zhang, Yu Gao, Yibin Ding, Weipeng Jiang, Weixi Zhang, Wei Han, Bo Bai

AI总结:

本文提出PR-GPT方法,通过在小合成图上预训练深度图学习模型并进行归纳推理,为大规模图划分提供高质量初始化,再结合InfoMap等精化方法,在保持划分质量的同时显著提升推理效率。

摘要:

图划分(GP)是一个经典问题,其目标是将图的节点集划分为连接紧密的块。遵循IEEE HPEC图挑战赛以及预训练技术(例如大语言模型)的最新进展,我们提出了PR-GPT(Pre-trained & Refined Graph ParTitioning,预训练与精化的图划分),其基于一种新颖的预训练与精化范式。我们首先在具有各种拓扑性质的小型合成图上对深度图学习(DGL)模型进行离线预训练。通过利用DGL的归纳推理能力,可以直接将预训练模型(冻结模型参数)泛化到大型图上,并获得可行的图划分结果。我们还将得到的划分作为高效图划分方法(例如InfoMap)的良好初始化,以进一步精化划分质量。在该设定下,PR-GPT的在线泛化与精化不仅能受益于质量方面的迁移能力,还能确保高推理效率而无需重新训练。基于一种缩减待精化方法处理图规模的机制,PR-GPT还具有支持流式图划分的潜力。在Graph Challenge基准上的实验表明,与从头运行精化方法相比,PR-GPT能够在大规模图上确保更快的图划分,且不会显著降低质量。我们将在https://github.com/KuroginQin/PRGPT公开代码。

英文摘要:

Graph partitioning (GP) is a classic problem that divides the node set of a graph into densely-connected blocks. Following the IEEE HPEC Graph Challenge and recent advances in pre-training techniques (e.g., large-language models), we propose PR-GPT (Pre-trained & Refined Graph ParTitioning) based on a novel pre-training & refinement paradigm. We first conduct the offline pre-training of a deep graph learning (DGL) model on small synthetic graphs with various topology properties. By using the inductive inference of DGL, one can directly generalize the pre-trained model (with frozen model parameters) to large graphs and derive feasible GP results. We also use the derived partition as a good initialization of an efficient GP method (e.g., InfoMap) to further refine the quality of partitioning. In this setting, the online generalization and refinement of PR-GPT can not only benefit from the transfer ability regarding quality but also ensure high inference efficiency without re-training. Based on a mechanism of reducing the scale of a graph to be processed by the refinement method, PR-GPT also has the potential to support streaming GP. Experiments on the Graph Challenge benchmark demonstrate that PR-GPT can ensure faster GP on large-scale graphs without significant quality degradation, compared with running a refinement method from scratch. We will make our code public at https://github.com/KuroginQin/PRGPT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑