arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.01688cs.DC
收藏

最佳负载均衡及现有负载均衡准则的评价

Optimal Load Balancing and Assessment of Existing Load Balancing Criteria

Anthony Boulmier, Nabil Abdennadher, Bastien Chopard

摘要:

并行迭代应用程序经常遭受负载不平衡,最关键的性能下降因素之一。因此,使用负载均衡技术来均匀地分布工作负载以最大化性能。一个关键的挑战是了解\textit{when}使用负载均衡技术。通常,这通过负载均衡标准来完成,该标准基于运行时应用数据和/或用户定义的信息来触发负载均衡。在本文的第一部分中,我们介绍了一种新的,自动负载均衡标准来自一个简单的数学模型。在第二部分中,我们提出了一个分支定界算法来找到负载均衡迭代,导致最佳的应用程序性能。该算法在二次时间内找到最佳负载均衡方案,而据我们所知,这从未在小于指数时间内得到解决。最后,我们比较了性能的情况下产生的最先进的负载均衡标准相对于最佳的负载均衡的情况下,在合成基准和并行N体模拟。在合成基准测试中,我们观察到所提出的标准优于其他自动标准。在数值实验中,我们表明,我们的新标准是,平均而言,$4.9\%$比国家的最先进的负载均衡标准,可以胜过他们高达$17.6\%$。此外,我们在数值研究中看到,最先进的自动标准在最坏的情况下$47.4\%$比最佳的慢,在最好的情况下$16.5\%$慢。

英文摘要:

Parallel iterative applications often suffer from load imbalance, one of the most critical performance degradation factors. Hence, load balancing techniques are used to distribute the workload evenly to maximize performance. A key challenge is to know \textit{when} to use load balancing techniques. In general, this is done through load balancing criteria, which trigger load balancing based on runtime application data and/or user-defined information. In the first part of this paper, we introduce a novel, automatic load balancing criterion derived from a simple mathematical model. In the second part, we propose a branch-and-bound algorithm to find the load balancing iterations that lead to the optimal application performance. This algorithm finds the optimal load balancing scenario in quadratic time while, to the best of our knowledge, this has never been addressed in less than an exponential time. Finally, we compare the performance of the scenarios produced by state-of-the-art load balancing criteria relative to the optimal load balancing scenario in synthetic benchmarks and parallel N-body simulations. In the synthetic benchmarks, we observe that the proposed criterion outperforms the other automatic criteria. In the numerical experiments, we show that our new criterion is, on average, $4.9\%$ faster than state-of-the-art load balancing criteria and can outperform them by up to $17.6\%$. Moreover, we see in the numerical study that the state-of-the-art automatic criteria are at worst $47.4\%$ slower than the optimum and at best $16.5\%$ slower.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑