arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.00959cs.SIcs.LGstat.ML
收藏

CogDL:一个面向图深度学习的综合性库

CogDL: A Comprehensive Library for Graph Deep Learning

Tsinghua University(清华大学);Zhejiang University(浙江大学);Zhipu AI(智谱AI);Shanghai Jiao Tong University(上海交通大学)
Yukuo Cen, Zhenyu Hou, Yan Wang, Qibin Chen, Yizhen Luo, Zhongming Yu, Hengrui Zhang, Xingcheng Yao, Aohan Zeng, Shiguang Guo, Yuxiao Dong, Yang Yang, Peng Zhan… 展开作者

Yukuo Cen, Zhenyu Hou, Yan Wang, Qibin Chen, Yizhen Luo, Zhongming Yu, Hengrui Zhang, Xingcheng Yao, Aohan Zeng, Shiguang Guo, Yuxiao Dong, Yang Yang, Peng Zhang, Guohao Dai, Yu Wang, Chang Zhou, Hongxia Yang, Jie Tang

AI总结:

本文提出综合性图深度学习库 CogDL,通过统一训练评估设计、混合精度训练和高效稀疏算子,解决图数据稀疏、训练复杂及评估不标准等问题,并维护可复现的基准结果。

摘要:

近年来,图神经网络(GNNs)引起了图学习社区的极大关注。它已被广泛应用于来自不同领域的各种实际应用中,例如社交网络和生物图。图深度学习的研究与应用带来了新的挑战,包括图数据的稀疏特性、GNNs 的复杂训练以及图任务的非标准评估。为了解决这些问题,我们提出了 CogDL,这是一个面向图深度学习的综合性库,使研究人员和从业者能够轻松高效地进行实验、比较方法和构建应用。在 CogDL 中,我们针对各种图任务提出了 GNN 模型训练与评估的统一设计,这使其在现有的图学习库中独树一帜。通过利用这一统一的训练器,CogDL 可以采用多种训练技术(例如混合精度训练)来优化 GNN 训练循环。此外,我们为 CogDL 开发了高效的稀疏算子,使其成为在效率方面最具竞争力的图库。CogDL 的另一个重要特点是注重易用性,旨在促进开放且可复现的图学习研究。我们利用 CogDL 报告并维护基础图任务的基准结果,这些结果可以被社区复现并直接使用。

英文摘要:

Graph neural networks (GNNs) have attracted tremendous attention from the graph learning community in recent years. It has been widely adopted in various real-world applications from diverse domains, such as social networks and biological graphs. The research and applications of graph deep learning present new challenges, including the sparse nature of graph data, complicated training of GNNs, and non-standard evaluation of graph tasks. To tackle the issues, we present CogDL, a comprehensive library for graph deep learning that allows researchers and practitioners to conduct experiments, compare methods, and build applications with ease and efficiency. In CogDL, we propose a unified design for the training and evaluation of GNN models for various graph tasks, making it unique among existing graph learning libraries. By utilizing this unified trainer, CogDL can optimize the GNN training loop with several training techniques, such as mixed precision training. Moreover, we develop efficient sparse operators for CogDL, enabling it to become the most competitive graph library for efficiency. Another important CogDL feature is its focus on ease of use with the aim of facilitating open and reproducible research of graph learning. We leverage CogDL to report and maintain benchmark results on fundamental graph tasks, which can be reproduced and directly used by the community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑