arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1902.03522cs.DScs.DBcs.DC
收藏

基于投影梯度下降的多维平衡图划分

Multi-Dimensional Balanced Graph Partitioning via Projected Gradient Descent

Dmitrii Avdiukhin, Sergey Pupyrev, Grigory Yaroslavtsev

摘要:

出于大规模图形处理系统的性能优化,分布在多台机器上的图形,我们认为平衡图划分问题。与以前的工作相比,我们研究了多维变量时,根据多个权重函数的平衡是必需的。正如我们通过实验评估所证明的那样,这种多维平衡对于实现典型分布式图处理工作负载的性能改进非常重要。我们提出了一个新的可扩展技术的多维平衡图划分问题。该方法是基于应用随机投影梯度下降的非凸连续松弛的目标。我们展示了如何有效地实现新算法在理论和实践中利用各种方法进行投影。在包含数千亿条边的大规模社交网络上的实验表明,与现有的方法相比,该算法具有更好的性能。

英文摘要:

Motivated by performance optimization of large-scale graph processing systems that distribute the graph across multiple machines, we consider the balanced graph partitioning problem. Compared to the previous work, we study the multi-dimensional variant when balance according to multiple weight functions is required. As we demonstrate by experimental evaluation, such multi-dimensional balance is important for achieving performance improvements for typical distributed graph processing workloads. We propose a new scalable technique for the multidimensional balanced graph partitioning problem. The method is based on applying randomized projected gradient descent to a non-convex continuous relaxation of the objective. We show how to implement the new algorithm efficiently in both theory and practice utilizing various approaches for projection. Experiments with large-scale social networks containing up to hundreds of billions of edges indicate that our algorithm has superior performance compared with the state-of-the-art approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑