Fifer：解决无服务器时代的利用率不足问题
Fifer: Tackling Underutilization in the Serverless Era
摘要：
数据中心正在见证基于微服务的应用程序采用无服务器功能的快速增长。这些微服务中的绝大多数通常跨度不到一秒，具有严格的SLO要求，并根据应用程序的要求链接在一起。上述特征引入了一系列新的挑战，特别是在容器配置和管理方面，因为在无服务器平台中采用的最先进的资源管理框架倾向于关注基于微服务的应用程序，类似于传统的单片应用程序。因此，这些框架遭受微服务不可知的调度和巨大的容器过度供应，特别是在工作负载波动期间，从而导致资源利用率低下。在这项工作中，我们使用Kubernetes和Brigade无服务器框架管理的多节点集群上的各种工作负载来量化上述缺点。为了解决这些问题，我们提出了\emph{Fifer} -一个自适应资源管理框架，以有效地管理无服务器平台上的功能链。其关键思想是使\emph{Fifer}（i）通过使用功能感知的容器缩放和智能请求调度来有效地将作业装箱到更少的容器，从而使其具有利用率意识;（ii）同时，通过主动生成容器以避免冷启动，从而使其符合SLO，从而最小化整体响应延迟。结合这些优势，与无服务器平台采用的最先进的路由器相比，\emph{Fifer}将容器利用率和集群范围的能耗分别提高了4倍和31%，而不会影响SLO。
英文摘要：
Datacenters are witnessing a rapid surge in the adoption of serverless functions for microservices-based applications. A vast majority of these microservices typically span less than a second, have strict SLO requirements, and are chained together as per the requirements of an application. The aforementioned characteristics introduce a new set of challenges, especially in terms of container provisioning and management, as the state-of-the-art resource management frameworks, employed in serverless platforms, tend to look at microservice-based applications similar to conventional monolithic applications. Hence, these frameworks suffer from microservice-agnostic scheduling and colossal container over-provisioning, especially during workload fluctuations, thereby resulting in poor resource utilization. In this work, we quantify the above shortcomings using a variety of workloads on a multi-node cluster managed by Kubernetes and Brigade serverless framework. To address them, we propose \emph{Fifer} -- an adaptive resource management framework to efficiently manage function-chains on serverless platforms. The key idea is to make \emph{Fifer} (i) utilization conscious by efficiently bin packing jobs to fewer containers using function-aware container scaling and intelligent request batching, and (ii) at the same time, SLO-compliant by proactively spawning containers to avoid cold-starts, thus minimizing the overall response latency. Combining these benefits, \emph{Fifer} improves container utilization and cluster-wide energy consumption by 4x and 31%, respectively, without compromising on SLO's, when compared to the state-of-the-art schedulers employed by serverless platforms.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
