arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.14879math.OCcs.PF
收藏

云中资源分配的最优控制策略:马尔可夫决策过程与启发式方法的比较

Optimal control policies for resource allocation in the Cloud: comparison between Markov decision process and heuristic approaches

Thomas Tournaire, Hind Castel-Taleb, Emmanuel Hyon

摘要:

我们考虑在云系统中的自动扩展技术,其中物理节点上托管的虚拟机根据队列的占用(或阈值)打开和关闭,以最大限度地减少集成能耗和性能的全局成本。我们提出了几种有效的优化方法来找到门限值最小化这个全球成本:本地搜索算法加上聚合的马尔可夫链和队列近似技术,以减少执行时间,提高精度。第二种方法处理的问题与马尔可夫决策过程(MDP),我们进行了理论研究,并提供与第一种方法的理论比较。我们还开发了结构化的MDP算法集成滞后特性。我们表明,MDP算法(值迭代,政策迭代),特别是结构化MDP算法优于设计的算法,在时间执行和准确性方面。最后,我们提出了一个云系统的实际场景的成本模型,以应用我们的优化算法,并显示其相关性。

英文摘要:

We consider an auto-scaling technique in a cloud system where virtual machines hosted on a physical node are turned on and off depending on the queue's occupation (or thresholds), in order to minimise a global cost integrating both energy consumption and performance. We propose several efficient optimisation methods to find threshold values minimising this global cost: local search heuristics coupled with aggregation of Markov chain and with queues approximation techniques to reduce the execution time and improve the accuracy. The second approach tackles the problem with a Markov Decision Process (MDP) for which we proceed to a theoretical study and provide theoretical comparison with the first approach. We also develop structured MDP algorithms integrating hysteresis properties. We show that MDP algorithms (value iteration, policy iteration) and especially structured MDP algorithms outperform the devised heuristics, in terms of time execution and accuracy. Finally, we propose a cost model for a real scenario of a cloud system to apply our optimisation algorithms and show their relevance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑