arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2201.07916cs.LGcs.SYeess.SY
收藏

PROMPT:学习网络应用的动态资源分配策略

PROMPT: Learning Dynamic Resource Allocation Policies for Network Applications

Oregon State University(俄勒冈州立大学);Intel Labs(英特尔实验室);Intel Corporation(英特尔公司)

Drew Penney, Bin Li, Jaroslaw Sydir, Lizhong Chen, Charlie Tai, Stefan Lee, Eoin Walsh, Thomas Long

摘要:

越来越多的服务提供商正在探索通过协同调度高优先级延迟关键型工作负载和尽力而为型工作负载来提高服务器利用率和降低功耗的方法。这种做法需要在工作负载之间进行严格的资源分配,以减少争用并保持服务质量(QoS)保证。以前的工作表现出有前途的机会,动态分配资源的工作负载需求的基础上,但可能无法满足QoS目标,在更严格的操作环境中,由于存在的资源分配悬崖,工作负载性能的瞬态波动,并迅速变化的资源需求。因此,我们提出了PROMPT,一种新的资源分配框架,使用主动QoS预测来指导强化学习控制器。PROMPT可以实现更精确的资源优化、更一致的瞬态行为处理以及更健壮的泛化,从而可以协同调度策略训练期间未遇到的新的尽力而为工作负载。评估表明,所提出的方法招致4.2倍的QoS违规,降低了12.7倍的QoS违规的严重程度,提高了尽力而为的工作负载性能,并提高了整体的电源效率比以前的工作。

英文摘要:

A growing number of service providers are exploring methods to improve server utilization and reduce power consumption by co-scheduling high-priority latency-critical workloads with best-effort workloads. This practice requires strict resource allocation between workloads to reduce contention and maintain Quality-of-Service (QoS) guarantees. Prior work demonstrated promising opportunities to dynamically allocate resources based on workload demand, but may fail to meet QoS objectives in more stringent operating environments due to the presence of resource allocation cliffs, transient fluctuations in workload performance, and rapidly changing resource demand. We therefore propose PROMPT, a novel resource allocation framework using proactive QoS prediction to guide a reinforcement learning controller. PROMPT enables more precise resource optimization, more consistent handling of transient behaviors, and more robust generalization when co-scheduling new best-effort workloads not encountered during policy training. Evaluation shows that the proposed method incurs 4.2x fewer QoS violations, reduces severity of QoS violations by 12.7x, improves best-effort workload performance, and improves overall power efficiency over prior work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑