arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.09213cs.DC
收藏

面向深度学习工作负载的异构感知集群调度策略

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, Amar Phanishayee, Matei Zaharia

摘要:

GPU、TPU、FPGA和定制ASIC等专用加速器已越来越多地部署用于训练深度学习模型。这些加速器在模型架构中表现出异构的性能行为。用于加速器集群的现有算法,用于在许多用户之间仲裁这些昂贵的培训资源,已经展示了如何优化各种多任务,多用户目标,如公平性和完工时间。不幸的是,现有的性能分析器在很大程度上没有考虑性能异质性。在本文中,我们提出了Gavel,一个异构性感知调度系统,广泛的现有的调度策略。Gavel将这些策略表示为优化问题,使得以异构感知的方式为目标进行优化变得容易,同时也认识到了空间共享等性能优化。然后,Gavel使用基于轮的调度机制来确保作业在给定目标调度策略的情况下获得理想的分配。Gavel的异构感知策略允许异构集群维持更高的输入负载,并将最终目标(如平均作业完成时间和完工时间)提高到异构不可知策略的3.5倍。

英文摘要:

Specialized accelerators such as GPUs, TPUs, FPGAs, and custom ASICs have been increasingly deployed to train deep learning models. These accelerators exhibit heterogeneous performance behavior across model architectures. Existing schedulers for clusters of accelerators, which are used to arbitrate these expensive training resources across many users, have shown how to optimize for various multi-job, multi-user objectives, like fairness and makespan. Unfortunately, existing schedulers largely do not consider performance heterogeneity. In this paper, we propose Gavel, a heterogeneity-aware scheduler that systematically generalizes a wide range of existing scheduling policies. Gavel expresses these policies as optimization problems, making it easy to optimize for objectives in a heterogeneity-aware way, while also being cognizant of performance optimizations like space sharing. Gavel then uses a round-based scheduling mechanism to ensure jobs receive their ideal allocation given the target scheduling policy. Gavel's heterogeneity-aware policies allow a heterogeneous cluster to sustain higher input load, and improve end objectives such as average job completion time and makespan by up to 3.5x compared to heterogeneity-agnostic policies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑