ANDREAS:人工智能traiNing scheDuler foR accElerAted资源clusterS
ANDREAS: Artificial intelligence traiNing scheDuler foR accElerAted resource clusterS
摘要:
人工智能(AI)和深度学习(DL)算法目前应用于广泛的产品和解决方案。深度学习培训工作对资源的要求很高,在利用人工智能加速器时,他们会获得很大的好处(例如,GPU)。然而,GPU驱动的集群的有效管理带来了巨大的挑战。其中,高效的调度和资源分配解决方案对于最大限度地提高性能和降低数据中心运营成本至关重要。在本文中,我们提出了ANDREAS,这是一种高级调度解决方案,可以共同解决这些问题,旨在优化DL训练运行时工作负载及其在加速集群中的能耗。基于仿真的实验表明,我们可以实现平均30和62%之间的成本降低相对于第一原理方法,而在一个真实的集群验证显示,最坏情况下的实际和预测的成本之间的偏差低于13%,证明了ANDREAS解决方案在实际场景中的有效性。
英文摘要:
Artificial Intelligence (AI) and Deep Learning (DL) algorithms are currently applied to a wide range of products and solutions. DL training jobs are highly resource demanding and they experience great benefits when exploiting AI accelerators (e.g., GPUs). However, the effective management of GPU-powered clusters comes with great challenges. Among these, efficient scheduling and resource allocation solutions are crucial to maximize performance and minimize Data Centers operational costs. In this paper we propose ANDREAS, an advanced scheduling solution that tackles these problems jointly, aiming at optimizing DL training runtime workloads and their energy consumption in accelerated clusters. Experiments based on simulation demostrate that we can achieve a cost reduction between 30 and 62% on average with respect to first-principle methods while the validation on a real cluster shows a worst case deviation below 13% between actual and predicted costs, proving the effectiveness of ANDREAS solution in practical scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。