arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.05772cs.NIcs.LG
收藏

SQLR:用于弹性配置的短期内存Q-Learning

SQLR: Short-Term Memory Q-Learning for Elastic Provisioning

IMDEA Networks Institute(IMDEA网络研究所);University Carlos III of Madrid(马德里卡洛斯三世大学);University of Trento(特伦托大学)

Constantine Ayimba, Paolo Casari, Vincenzo Mancuso

摘要:

随着越来越多的应用程序提供商过渡到云并在软件即服务(SaaS)的基础上提供服务,云提供商需要使其配置系统足够灵活,以满足服务水平协议。与此同时,他们应防止过度供应,这限制了他们容纳更多租户的能力。为此,我们提出SQLR,一个动态配置系统,采用定制的无模型强化学习算法,能够重用从一个工作负载的上下文知识,以优化资源配置为其他工作负载模式。SQLR实现的结果与资源不受约束的结果相当,并且开销最小。我们的实验表明,我们可以减少近25%的供应资源的量,不到1%的整体服务不可用(由于阻塞),同时提供类似的响应时间的过度供应的系统。

英文摘要:

As more and more application providers transition to the cloud and deliver their services on a Software as a Service (SaaS) basis, cloud providers need to make their provisioning systems agile enough to meet Service Level Agreements. At the same time they should guard against over-provisioning which limits their capacity to accommodate more tenants. To this end we propose SQLR, a dynamic provisioning system employing a customized model-free reinforcement learning algorithm that is capable of reusing contextual knowledge learned from one workload to optimize resource provisioning for other workload patterns. SQLR achieves results comparable to those where resources are unconstrained, with minimal overhead. Our experiments show that we can reduce the amount of provisioned resources by almost 25% with less than 1% overall service unavailability (due to blocking) while delivering similar response times as those of an over-provisioned system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑