arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.17574cs.SEcs.DC
收藏

SPES:面向无服务器函数性能-资源权衡优化的研究

SPES: Towards Optimizing Performance-Resource Trade-Off for Serverless Functions

Cheryl Lee, Zhouruixing Zhu, Tianyi Yang, Yintong Huo, Yuxin Su, Pinjia He, Michael R. Lyu

AI总结:

针对无服务器计算冷启动延迟与资源浪费的权衡问题,提出差异化调度器SPES,利用调用模式预测实现细粒度预加载/卸载,显著降低冷启动率与内存浪费。

摘要:

作为一种新兴的云计算部署范式,无服务器计算因其高效性和利用按需云资源的能力而日益受到关注。然而,冷启动问题仍然是一个重大障碍,它导致从零开始启动新函数实例时产生延迟。现有解决方案倾向于采用过于简化的函数预加载/卸载策略,未能充分利用调用模式,导致冷启动延迟与资源浪费之间的权衡优化效果不佳。为弥补这一差距,我们提出了SPES,这是首个通过优化无服务器函数供应来缓解运行时冷启动问题的差异化调度器。我们的洞察在于,无服务器系统的通用架构促使某些调用模式集中出现,从而导致可预测的调用行为。这使得我们能够对函数进行分类,并基于准确的调用预测,采用更细粒度的策略预加载/卸载适当的函数实例。实验证明了SPES在优化无服务器函数供应两方面的成功:与最先进方法相比,第75百分位冷启动率降低了49.77%,浪费的内存时间减少了56.43%。通过缓解冷启动问题,SPES在促进部署于无服务器架构上的云服务方面是一项有前景的进步。

英文摘要:

As an emerging cloud computing deployment paradigm, serverless computing is gaining traction due to its efficiency and ability to harness on-demand cloud resources. However, a significant hurdle remains in the form of the cold start problem, causing latency when launching new function instances from scratch. Existing solutions tend to use over-simplistic strategies for function pre-loading/unloading without full invocation pattern exploitation, rendering unsatisfactory optimization of the trade-off between cold start latency and resource waste. To bridge this gap, we propose SPES, the first differentiated scheduler for runtime cold start mitigation by optimizing serverless function provision. Our insight is that the common architecture of serverless systems prompts the concentration of certain invocation patterns, leading to predictable invocation behaviors. This allows us to categorize functions and pre-load/unload proper function instances with finer-grained strategies based on accurate invocation prediction. Experiments demonstrate the success of SPES in optimizing serverless function provision on both sides: reducing the 75th-percentile cold start rates by 49.77% and the wasted memory time by 56.43%, compared to the state-of-the-art. By mitigating the cold start issue, SPES is a promising advancement in facilitating cloud services deployed on serverless architectures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑