arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.14410cs.DCcs.AIcs.LG
收藏

基于人工智能的资源分配:无服务器环境中自适应自动扩展的强化学习

AI-based Resource Allocation: Reinforcement Learning for Adaptive Auto-scaling in Serverless Environments

Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);IBM Research & Development GmbH(IBM研发有限责任公司);IBM Deutschland GmbH(IBM德国有限责任公司)

Lucia Schuler, Somaya Jamil, Niklas Kühl

摘要:

近年来,无服务器计算已经成为云计算模型的一个引人注目的新范例。它承诺以大规模和低成本提供用户服务,同时消除对基础设施管理的需求。在云提供商方面,需要灵活的资源管理来满足波动的需求。它可以通过自动配置和取消配置资源来启用。商业和开源无服务器计算平台中的一种常见方法是基于工作负载的自动扩展,其中指定的算法根据传入请求的数量扩展实例。在最近发展的无服务器框架Knative中,提出了一种基于请求的策略,该算法通过配置每个实例可以并行处理的最大请求数量来扩展资源,即所谓的并发性。正如我们在基线实验中所展示的那样,这种预定义的并发级别可以强烈影响无服务器应用程序的性能。然而,由于各种因素,例如变化的工作负载和复杂的基础设施特性,识别产生最高可能的服务质量的并发配置是一项具有挑战性的任务,影响吞吐量和延迟。虽然对优化虚拟机配置的自动扩展的智能技术进行了大量研究,但在无服务器计算领域尚未讨论该主题。出于这个原因,我们研究了强化学习方法的适用性,该方法已在动态虚拟机配置中得到证明,可以在无服务器框架中基于请求的自动扩展。我们的研究结果表明,在有限的迭代次数内,我们提出的模型可以根据工作负载学习有效的扩展策略,与默认的自动扩展配置相比,提高了性能。

英文摘要:

Serverless computing has emerged as a compelling new paradigm of cloud computing models in recent years. It promises the user services at large scale and low cost while eliminating the need for infrastructure management. On cloud provider side, flexible resource management is required to meet fluctuating demand. It can be enabled through automated provisioning and deprovisioning of resources. A common approach among both commercial and open source serverless computing platforms is workload-based auto-scaling, where a designated algorithm scales instances according to the number of incoming requests. In the recently evolving serverless framework Knative a request-based policy is proposed, where the algorithm scales resources by a configured maximum number of requests that can be processed in parallel per instance, the so-called concurrency. As we show in a baseline experiment, this predefined concurrency level can strongly influence the performance of a serverless application. However, identifying the concurrency configuration that yields the highest possible quality of service is a challenging task due to various factors, e.g. varying workload and complex infrastructure characteristics, influencing throughput and latency. While there has been considerable research into intelligent techniques for optimizing auto-scaling for virtual machine provisioning, this topic has not yet been discussed in the area of serverless computing. For this reason, we investigate the applicability of a reinforcement learning approach, which has been proven on dynamic virtual machine provisioning, to request-based auto-scaling in a serverless framework. Our results show that within a limited number of iterations our proposed model learns an effective scaling policy per workload, improving the performance compared to the default auto-scaling configuration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑