arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1607.06156cs.DC
收藏

一种计算连通分支的自适应并行算法

An Adaptive Parallel Algorithm for Computing Connected Components

Chirag Jain, Patrick Flick, Tony Pan, Oded Green, Srinivas Aluru

摘要:

基于Shiloach-Vishkin的PRAM方法,提出了一种高效的计算无向图连通分支的分布式内存并行算法。我们讨论了多种优化技术,减少通信量以及负载平衡的算法。我们还注意到,并行图连通性算法的效率取决于底层图的拓扑结构。特别是对于短直径的图形组件,我们观察到并行广度优先搜索(BFS)方法提供了更好的性能。然而,运行并行BFS对于计算大直径组件或大量小组件是低效的。为了解决这一挑战,我们采用了一种启发式算法,允许算法通过计算度分布来快速预测网络的类型,并遵循最佳混合路由。使用大型图形与不同的拓扑结构域,包括宏基因组学,网络抓取,社交图和道路网络,我们表明,我们的混合实现是有效的,可扩展的每一个图形类型。我们的方法实现了215秒的运行时间,使用32 K核心的Cray XC 30的宏基因组图超过500亿条边。与以前的最先进的方法相比,我们看到性能提高了24倍。

英文摘要:

We present an efficient distributed memory parallel algorithm for computing connected components in undirected graphs based on Shiloach-Vishkin's PRAM approach. We discuss multiple optimization techniques that reduce communication volume as well as load-balance the algorithm. We also note that the efficiency of the parallel graph connectivity algorithm depends on the underlying graph topology. Particularly for short diameter graph components, we observe that parallel Breadth First Search (BFS) method offers better performance. However, running parallel BFS is not efficient for computing large diameter components or large number of small components. To address this challenge, we employ a heuristic that allows the algorithm to quickly predict the type of the network by computing the degree distribution and follow the optimal hybrid route. Using large graphs with diverse topologies from domains including metagenomics, web crawl, social graph and road networks, we show that our hybrid implementation is efficient and scalable for each of the graph types. Our approach achieves a runtime of 215 seconds using 32K cores of Cray XC30 for a metagenomic graph with over 50 billion edges. When compared against the previous state-of-the-art method, we see performance improvements up to 24x.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑