arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 1708.07985cs.DC
收藏

GiViP:分布式图处理系统的可视化分析器

GiViP: A Visual Profiler for Distributed Graph Processing Systems

Alessio Arleo, Walter Didimo, Giuseppe Liotta, Fabrizio Montecchiani

摘要:

分析大规模图可以在不同的应用场景中提供有价值的见解。虽然已经提出了许多在分布式基础设施上工作的图处理系统来处理大型图,但分析和调试其大量计算的任务仍然非常耗时且容易出错。本文介绍了GiViP,基于Pregel计算模型的分布式图形处理系统的可视化分析器。GiViP捕获了在整个计算过程中交换的大量消息,并提供了一个交互式用户界面,用于对收集的数据进行可视化分析。我们将展示如何利用GiViP来检测与计算和基础设施相关的异常,例如计算速度慢的单元和异常的消息模式。

英文摘要:

Analyzing large-scale graphs provides valuable insights in different application scenarios. While many graph processing systems working on top of distributed infrastructures have been proposed to deal with big graphs, the tasks of profiling and debugging their massive computations remain time consuming and error-prone. This paper presents GiViP, a visual profiler for distributed graph processing systems based on a Pregel-like computation model. GiViP captures the huge amount of messages exchanged throughout a computation and provides an interactive user interface for the visual analysis of the collected data. We show how to take advantage of GiViP to detect anomalies related to the computation and to the infrastructure, such as slow computing units and anomalous message patterns.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑