arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.15082cs.LG
收藏

DGI:GNN的简单高效推理

DGI: Easy and Efficient Inference for GNNs

AWS Shanghai AI Lab(AWS上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Southern University of Science and Technology(南方科技大学);TensorChord;The George Washington University(乔治华盛顿大学)

Peiqi Yin, Xiao Yan, Jinjing Zhou, Qiang Fu, Zhenkun Cai, James Cheng, Bo Tang, Minjie Wang

摘要:

虽然已经开发了许多系统来训练图神经网络(GNN),但是仍然需要解决有效的模型推理和评估。例如,使用广泛采用的逐节点方法,由于邻居爆炸,模型评估可以在端到端训练过程中占高达94%的时间,这意味着节点访问其多跳邻居。另一方面,逐层推理通过逐层进行推理使得节点在每层中仅需要其一跳邻居来避免邻居爆炸问题。然而,实现逐层推理需要大量的工程工作,因为用户需要手动将GNN模型分解为用于计算的层,并将工作负载分成批次以适应设备内存。在本文中,我们开发了深度图推理(DGI)-一个简单有效的GNN模型推理系统,它自动转换GNN模型的训练代码以进行逐层执行。DGI通用于各种GNN模型和不同类型的推理请求,并支持在无法容纳CPU内存的大型图形上的核外执行。实验结果表明,DGI在不同数据集和硬件设置上的性能始终优于分层推理,加速比可以超过1,000倍。

英文摘要:

While many systems have been developed to train Graph Neural Networks (GNNs), efficient model inference and evaluation remain to be addressed. For instance, using the widely adopted node-wise approach, model evaluation can account for up to 94% of the time in the end-to-end training process due to neighbor explosion, which means that a node accesses its multi-hop neighbors. On the other hand, layer-wise inference avoids the neighbor explosion problem by conducting inference layer by layer such that the nodes only need their one-hop neighbors in each layer. However, implementing layer-wise inference requires substantial engineering efforts because users need to manually decompose a GNN model into layers for computation and split workload into batches to fit into device memory. In this paper, we develop Deep Graph Inference (DGI) -- a system for easy and efficient GNN model inference, which automatically translates the training code of a GNN model for layer-wise execution. DGI is general for various GNN models and different kinds of inference requests, and supports out-of-core execution on large graphs that cannot fit in CPU memory. Experimental results show that DGI consistently outperforms layer-wise inference across different datasets and hardware settings, and the speedup can be over 1,000x.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑