arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.06145cs.DCcs.OScs.PF
收藏

无服务器冷启动及其发生场景探究

Serverless Cold Starts and Where to Find Them

Artjom Joosen, Ahmed Hassan, Martin Asenov, Rajkarn Singh, Luke Darlow, Jianfeng Wang, Qiwen Deng, Adam Barker

AI总结:

本文通过分析华为无服务器云平台850亿请求的月度追踪数据,拆解冷启动构成与影响因素,提出pod利用率指标,揭示不同区域冷启动的主导因素,并给出多区域调度优化方向与未来研究建议。

摘要:

本文发布并分析了来自华为无服务器云平台的为期一个月的 trace(追踪数据),涵盖850亿次用户请求与1190万次冷启动。我们的分析覆盖五个数据中心的工作负载,聚焦冷启动问题,全面探究了影响冷启动次数与持续时间的底层因素,包括触发器类型、请求同步性、运行时语言以及函数资源分配。我们拆解了冷启动的各个组成部分,包括pod(容器组)分配时间、代码与依赖部署时间以及调度延迟,并研究了这些组成部分与运行时语言、触发器类型、资源分配之间的关联。我们提出pod利用率(pod utility ratio)指标,用于衡量pod的有效生命周期相对于其冷启动时间的占比,从而更全面地刻画冷启动特征,研究发现部分冷启动时间较长的pod拥有更长的有效生命周期。我们的研究结果揭示了冷启动的次数、持续时间及特征的复杂性与多面性,其受触发器类型、运行时语言、函数资源分配的差异驱动。例如,区域1的冷启动最长可达7秒,主要由依赖部署时间和调度延迟主导;区域2的冷启动最长可达3秒,主要由pod分配时间主导。基于此,我们识别出通过多区域调度策略减少冷启动次数与时长的优化机会。最后,我们提出了未来研究的方向,以应对这些挑战并提升无服务器云平台的性能。我们的数据集与代码可在此处获取:https://github.com/sir-lab/data-release

英文摘要:

This paper releases and analyzes a month-long trace of 85 billion user requests and 11.9 million cold starts from Huawei's serverless cloud platform. Our analysis spans workloads from five data centers. We focus on cold starts and provide a comprehensive examination of the underlying factors influencing the number and duration of cold starts. These factors include trigger types, request synchronicity, runtime languages, and function resource allocations. We investigate components of cold starts, including pod allocation time, code and dependency deployment time, and scheduling delays, and examine their relationships with runtime languages, trigger types, and resource allocation. We introduce pod utility ratio to measure the pod's useful lifetime relative to its cold start time, giving a more complete picture of cold starts, and see that some pods with long cold start times have longer useful lifetimes. Our findings reveal the complexity and multifaceted origins of the number, duration, and characteristics of cold starts, driven by differences in trigger types, runtime languages, and function resource allocations. For example, cold starts in Region 1 take up to 7 seconds, dominated by dependency deployment time and scheduling. In Region 2, cold starts take up to 3 seconds and are dominated by pod allocation time. Based on this, we identify opportunities to reduce the number and duration of cold starts using strategies for multi-region scheduling. Finally, we suggest directions for future research to address these challenges and enhance the performance of serverless cloud platforms. Our datasets and code are available here https://github.com/sir-lab/data-release

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑