arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.01909cs.DC
收藏

面向云数据中心中采用多实例GPU技术的GPU使能虚拟机放置的多目标优化框架

A Multi-Objective Framework for Optimizing GPU-Enabled VM Placement in Cloud Data Centers with Multi-Instance GPU Technology

Ahmad Siavashi, Mahmoud Momtazpour

AI总结:

本文针对云数据中心中MIG技术导致的GPU资源碎片化问题,提出多阶段放置框架GRMU,通过GPU内/间迁移和配额分区策略,在真实集群轨迹上实现接受率提升22%、活跃硬件减少17%。

摘要:

GPU在云计算中的广泛使用以及多租户需求的日益增长,推动了高效GPU资源管理创新解决方案的发展。NVIDIA的多实例GPU(MIG)技术通过提供隔离实例,实现了云数据中心中的GPU共享使用。然而,MIG放置规则往往导致资源碎片化和次优的资源利用率。在本工作中,我们将支持MIG的虚拟机放置问题形式化建模为一个多目标整数线性规划(ILP)问题,旨在最大化请求接受率、最小化活跃硬件使用量并降低迁移开销。基于该形式化模型,我们提出了GRMU,一个多阶段放置框架,用于应对MIG放置挑战。GRMU执行GPU内迁移以对单个GPU进行碎片整理,并执行GPU间迁移以实现整合和资源效率提升。它还采用基于配额的分区方法,将GPU分配到两个不同的篮子中:一个用于大规格工作负载,另一个用于较小规格工作负载。每个篮子具有预定义的容量限制,确保公平的资源分配,并防止大规格工作负载独占资源。在真实世界阿里巴巴GPU集群轨迹上的评估表明,GRMU将接受率提高了22%,将活跃硬件减少了17%,且仅对1%的支持MIG的虚拟机产生迁移,证明了其在减少碎片化和提高资源利用率方面的有效性。

英文摘要:

The extensive use of GPUs in cloud computing and the growing need for multitenancy have driven the development of innovative solutions for efficient GPU resource management. Multi-Instance GPU (MIG) technology from NVIDIA enables shared GPU usage in cloud data centers by providing isolated instances. However, MIG placement rules often lead to fragmentation and suboptimal resource utilization. In this work, we formally model the MIG-enabled VM placement as a multi-objective Integer Linear Programming (ILP) problem aimed at maximizing request acceptance, minimizing active hardware usage, and reducing migration overhead. Building upon this formulation, we propose GRMU, a multi-stage placement framework designed to address MIG placement challenges. GRMU performs intra-GPU migrations for defragmentation of a single GPU and inter-GPU migrations for consolidation and resource efficiency. It also employs a quota-based partitioning approach to allocate GPUs into two distinct baskets: one for large-profile workloads and another for smaller-profile workloads. Each basket has predefined capacity limits, ensuring fair resource distribution and preventing large-profile workloads from monopolizing resources. Evaluations on a real-world Alibaba GPU cluster trace reveal that GRMU improves acceptance rates by 22%, reduces active hardware by 17%, and incurs migration for only 1% of MIG-enabled VMs, demonstrating its effectiveness in minimizing fragmentation and improving resource utilization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑