arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.08983cs.ARcs.AIcs.LG
收藏

G-CoS:GNN加速器共同搜索,以实现更高的准确性和效率

G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiency

Rice University(莱斯大学);Pacific Northwest National Laboratory(太平洋西北国家实验室)

Yongan Zhang, Haoran You, Yonggan Fu, Tong Geng, Ang Li, Yingyan Lin

摘要:

图神经网络(GNNs)已经成为基于图的学习任务的最先进(SOTA)方法。然而,在大型图数据集上推断GNN仍然具有极大的挑战性,限制了它们在大规模现实任务中的应用。虽然端到端联合优化GNN及其加速器在提高GNN的推理效率和加快设计过程方面很有希望,但由于GNN及其加速器的巨大而独特的设计空间,它仍然没有得到充分的探索。在这项工作中,我们提出了G-CoS,一个GNN和加速器共同搜索框架,可以自动搜索匹配的GNN结构和加速器,以最大限度地提高任务的准确性和加速效率。具体而言,GCoS集成了两个主要的使能组件:(1)适用于各种GNN结构的通用GNN加速器搜索空间,以及(2)一次性GNN和加速器共同搜索算法,该算法能够同时有效地搜索最佳GNN结构及其匹配的加速器。据我们所知,G-CoS是GNN及其加速器的第一个共同搜索框架。广泛的实验和消融研究表明,G-CoS生成的GNN和加速器在任务准确性和硬件效率方面始终优于SOTA GNN和GNN加速器,而端到端生成最佳匹配的GNN及其加速器只需要几个小时。

英文摘要:

Graph Neural Networks (GNNs) have emerged as the state-of-the-art (SOTA) method for graph-based learning tasks. However, it still remains prohibitively challenging to inference GNNs over large graph datasets, limiting their application to large-scale real-world tasks. While end-to-end jointly optimizing GNNs and their accelerators is promising in boosting GNNs' inference efficiency and expediting the design process, it is still underexplored due to the vast and distinct design spaces of GNNs and their accelerators. In this work, we propose G-CoS, a GNN and accelerator co-search framework that can automatically search for matched GNN structures and accelerators to maximize both task accuracy and acceleration efficiency. Specifically, GCoS integrates two major enabling components: (1) a generic GNN accelerator search space which is applicable to various GNN structures and (2) a one-shot GNN and accelerator co-search algorithm that enables simultaneous and efficient search for optimal GNN structures and their matched accelerators. To the best of our knowledge, G-CoS is the first co-search framework for GNNs and their accelerators. Extensive experiments and ablation studies show that the GNNs and accelerators generated by G-CoS consistently outperform SOTA GNNs and GNN accelerators in terms of both task accuracy and hardware efficiency, while only requiring a few hours for the end-to-end generation of the best matched GNNs and their accelerators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑