arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2105.03217cs.DC
收藏

无服务器计算中减少响应时间的数据驱动调度

Data-driven scheduling in serverless computing to reduce response time

Bartłomiej Przybylski, Paweł Żuk, Krzysztof Rzadca

摘要:

在功能即服务(FaaS)中,客户部署功能而不是完整的虚拟机或Linux容器。云提供商负责维护这些功能的运行时环境。FaaS产品由所有主要的云提供商提供(例如Amazon Lambda,Google Cloud Functions,Azure Functions);以及独立的开源软件(例如Apache OpenWhisk)及其商业变体(例如Adobe I/O Cloud或IBM Cloud Functions)。我们采用FaaS集群中单个节点的自底向上视角。我们假设已经安装了分配给这个节点的一组函数的所有执行环境。我们的目标是调度由负载均衡器传递的函数的单独调用,以最小化与响应时间相关的性能指标。部署的函数通常会重复执行,以响应最终用户的多次调用。因此,我们的调度决策是基于本地收集的信息:记录的调用频率和执行时间。我们提出了一些算法,我们也采用了一些理论上的基础,如SEPT或SERPT。我们的模拟使用最近发布的Azure Functions Trace。我们表明,相比基线FIFO或循环,我们的数据驱动的调度决策显着提高性能。

英文摘要:

In Function as a Service (FaaS), a serverless computing variant, customers deploy functions instead of complete virtual machines or Linux containers. It is the cloud provider who maintains the runtime environment for these functions. FaaS products are offered by all major cloud providers (e.g. Amazon Lambda, Google Cloud Functions, Azure Functions); as well as standalone open-source software (e.g. Apache OpenWhisk) with their commercial variants (e.g. Adobe I/O Runtime or IBM Cloud Functions). We take the bottom-up perspective of a single node in a FaaS cluster. We assume that all the execution environments for a set of functions assigned to this node have been already installed. Our goal is to schedule individual invocations of functions, passed by a load balancer, to minimize performance metrics related to response time. Deployed functions are usually executed repeatedly in response to multiple invocations made by end-users. Thus, our scheduling decisions are based on the information gathered locally: the recorded call frequencies and execution times. We propose a number of heuristics, and we also adapt some theoretically-grounded ones like SEPT or SERPT. Our simulations use a recently-published Azure Functions Trace. We show that, compared to the baseline FIFO or round-robin, our data-driven scheduling decisions significantly improve the performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑