arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08820stat.AP
收藏

具有并行处理、批量到达和异构服务需求的云的容量分配

Capacity Allocation for Clouds with Parallel Processing, Batch Arrivals, and Heterogeneous Service Requirements

Eugene Furman, Arik Senderovich, Shane Bergsma, J. Christopher Beck

摘要:

问题定义:为云服务分配足够的容量是一项具有挑战性的任务,特别是当需求随时间变化、异构、包含批次并且需要多种类型的资源进行处理时。在这种情况下,供应商决定是否将其能力的一部分保留给个别工作类别或以灵活的方式提供。方法/结果:我们与全球云服务提供商华为云合作,提出了一种启发式策略,该策略将多种类型的资源分配给作业,并满足其预先指定的服务水平协议(SLA)。我们将该系统建模为具有并行处理和多种类型资源的多类排队网络,其中到达(即,虚拟机和容器)遵循时变模式,并且需要每个资源的至少一个单元用于处理。虽然虚拟机在没有立即提供服务的情况下会离开,但容器可以加入队列。我们引入了一个扩散近似的提供这样的系统的负载,并调查其保真度相比,观察到的数据。然后,我们开发了一种启发式的方法,利用这种近似来确定容量水平,满足概率SLA的系统完全灵活的服务器。管理影响:使用华为云在8天内的典型云计算请求数据集,我们表明,与保留资源的基准测试相比,我们的启发式策略可以减少20%的容量,并提高服务质量。此外,我们表明,我们的政策诱导的系统利用率优于基准,即,这意味着在大多数情况下,资源闲置的情况较少。因此,我们的方法使云运营商能够降低成本并实现更好的性能。

英文摘要:

Problem Definition: Allocating sufficient capacity to cloud services is a challenging task, especially when demand is time-varying, heterogeneous, contains batches, and requires multiple types of resources for processing. In this setting, providers decide whether to reserve portions of their capacity to individual job classes or to offer it in a flexible manner. Methodology/results: In collaboration with Huawei Cloud, a worldwide provider of cloud services, we propose a heuristic policy that allocates multiple types of resources to jobs and also satisfies their pre-specified service level agreements (SLAs). We model the system as a multi-class queueing network with parallel processing and multiple types of resources, where arrivals (i.e., virtual machines and containers) follow time-varying patterns and require at least one unit of each resource for processing. While virtual machines leave if they are not served immediately, containers can join a queue. We introduce a diffusion approximation of the offered load of such system and investigate its fidelity as compared to the observed data. Then, we develop a heuristic approach that leverages this approximation to determine capacity levels that satisfy probabilistic SLAs in the system with fully flexible servers. Managerial Implications: Using a data set of cloud computing requests over a representative 8-day period from Huawei Cloud, we show that our heuristic policy results in a 20% capacity reduction and better service quality as compared to a benchmark that reserves resources. In addition, we show that the system utilization induced by our policy is superior to the benchmark, i.e., it implies less idling of resources in most instances. Thus, our approach enables cloud operators to both reduce costs and achieve better performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑