arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.13429cs.DC
收藏

Pronto:联合任务调度

Pronto: Federated Task Scheduling

Andreas Grammenos, Evangelia Kalyvianaki, Peter Pietzuch

摘要:

我们提出了一个联合的,异步的,内存有限的算法在线任务调度在大型网络的数百名工人。这是通过联合边缘计算的最新进展实现的,该技术解锁了在每个节点内分别增量计算本地模型更新的能力。然后,该本地模型与传入数据一起使用以生成拒绝信号,该拒绝信号反映整体节点响应性以及是否能够接受传入任务而不会导致性能下降。通过这种创新,我们允许每个节点根据迄今为止看到的工作负载独立地执行是否接受传入作业的调度决策。此外,使用迭代的集合可以根据需要构建系统的全局视图,并且可以用于生成系统的整体视图。我们补充了我们的研究结果,通过对虚拟化生产数据中心的大规模真实数据集进行实证评估,该数据集显示,虽然使用有限的内存,但我们的算法表现出最先进的性能。具体来说,它能够根据行业标准的CPU就绪指标提前预测系统响应能力的变化,从而可以更好地做出调度决策,提高可用资源的整体利用率。最后,在没有通信延迟的情况下,它表现出有吸引力的水平可扩展性。

英文摘要:

We present a federated, asynchronous, memory-limited algorithm for online task scheduling across large-scale networks of hundreds of workers. This is achieved through recent advancements in federated edge computing that unlocks the ability to incrementally compute local model updates within each node separately. This local model is then used along with incoming data to generate a rejection signal which reflects the overall node responsiveness and if it is able to accept an incoming task without resulting in degraded performance. Through this innovation, we allow each node to execute scheduling decisions on whether to accept an incoming job independently based on the workload seen thus far. Further, using the aggregate of the iterates a global view of the system can be constructed, as needed, and could be used to produce a holistic perspective of the system. We complement our findings, by an empirical evaluation on a large-scale real-world dataset of traces from a virtualized production data center that shows, while using limited memory, that our algorithm exhibits state-of-the-art performance. Concretely, it is able to predict changes in the system responsiveness ahead of time based on the industry-standard CPU-Ready metric and, in turn, can lead to better scheduling decisions and overall utilization of the available resources. Finally, in the absence of communication latency, it exhibits attractive horizontal scalability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑