NeutronStream:一种面向图流的带滑动窗口的动态 GNN 训练框架
NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams
AI总结:
针对动态图训练难以兼顾实时时空依赖与并行性能的问题,本文提出 NeutronStream,通过事件流、优化滑动窗口、并行引擎和动态图存储及 API,实现最高 5.87 倍加速并平均提升准确率 3.97%。
摘要:
现有的图神经网络(GNN)训练框架旨在帮助开发者轻松创建高性能的 GNN 实现。然而,大多数现有 GNN 框架都假设输入图是静态的,却忽视了大多数真实世界中的图会不断演化。尽管已经出现了许多动态 GNN 模型用于从演化图中学习,但这些动态 GNN 的训练过程与传统 GNN 存在显著差异,因为它同时捕获图更新的空间和时间依赖关系。这给设计动态 GNN 训练框架带来了新的挑战。首先,传统的批量训练方法无法捕获实时结构演化信息。其次,时间依赖特性使并行训练难以设计。第三,缺乏供用户高效实现动态 GNN 的系统支持。本文提出 NeutronStream,这是一个用于训练动态 GNN 模型的框架。NeutronStream 将输入动态图抽象为按时间顺序更新的事件流,并使用经过优化的滑动窗口处理该流,以增量方式捕获事件的时空依赖关系。此外,NeutronStream 提供并行执行引擎,以应对顺序事件处理挑战并实现高性能。NeutronStream 还集成了内置图存储结构,支持动态更新,并提供一组易于使用的 API,使用户能够表达其动态 GNN。实验结果表明,与最先进的动态 GNN 实现相比,NeutronStream 实现了 1.48 倍至 5.87 倍的加速,并且准确率平均提升 3.97%。
英文摘要:
Existing Graph Neural Network (GNN) training frameworks have been designed to help developers easily create performant GNN implementations. However, most existing GNN frameworks assume that the input graphs are static, but ignore that most real-world graphs are constantly evolving. Though many dynamic GNN models have emerged to learn from evolving graphs, the training process of these dynamic GNNs is dramatically different from traditional GNNs in that it captures both the spatial and temporal dependencies of graph updates. This poses new challenges for designing dynamic GNN training frameworks. First, the traditional batched training method fails to capture real-time structural evolution information. Second, the time-dependent nature makes parallel training hard to design. Third, it lacks system supports for users to efficiently implement dynamic GNNs. In this paper, we present NeutronStream, a framework for training dynamic GNN models. NeutronStream abstracts the input dynamic graph into a chronologically updated stream of events and processes the stream with an optimized sliding window to incrementally capture the spatial-temporal dependencies of events. Furthermore, NeutronStream provides a parallel execution engine to tackle the sequential event processing challenge to achieve high performance. NeutronStream also integrates a built-in graph storage structure that supports dynamic updates and provides a set of easy-to-use APIs that allow users to express their dynamic GNNs. Our experimental results demonstrate that, compared to state-of-the-art dynamic GNN implementations, NeutronStream achieves speedups ranging from 1.48X to 5.87X and an average accuracy improvement of 3.97%.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。