SeBS-Flow:无服务器云函数工作流基准测试
SeBS-Flow: Benchmarking Serverless Cloud Function Workflows
AI总结:
针对现有无服务器工作流平台差异大、难公平评估的问题,提出首个平台无关的基准测试套件SeBS-Flow,含10个基准,在三大云平台完成多维度评估并开源。
摘要:
无服务器计算已成为一种主流范式,在云客户中 adoption 率很高。尽管该模式具备部署与资源调度抽象等优势,但由于单个函数的受限特性,在处理复杂用例时存在局限性。无服务器工作流通过将多个函数编排为一个连贯的应用来解决这一局限。然而,现有无服务器工作流平台在编程模型和基础设施方面存在显著差异,使得实践中难以开展公平、一致的性能评估。为填补这一空白,我们提出了首个无服务器工作流基准测试套件 SeBS-Flow,它提供了一种平台无关的工作流模型,可在不同平台间开展一致的基准测试。SeBS-Flow 包含6个真实应用基准测试和4个代表不同计算模式的微基准测试。我们在三大主流云平台上开展了综合评估,对性能、成本、可扩展性和运行时偏差进行了测评。我们将该基准测试套件开源,以便长期对无服务器工作流开展严谨、可对比的评估。
英文摘要:
Serverless computing has emerged as a prominent paradigm, with a significant adoption rate among cloud customers. While this model offers advantages such as abstraction from the deployment and resource scheduling, it also poses limitations in handling complex use cases due to the restricted nature of individual functions. Serverless workflows address this limitation by orchestrating multiple functions into a cohesive application. However, existing serverless workflow platforms exhibit significant differences in their programming models and infrastructure, making fair and consistent performance evaluations difficult in practice. To address this gap, we propose the first serverless workflow benchmarking suite SeBS-Flow, providing a platform-agnostic workflow model that enables consistent benchmarking across various platforms. SeBS-Flow includes six real-world application benchmarks and four microbenchmarks representing different computational patterns. We conduct comprehensive evaluations on three major cloud platforms, assessing performance, cost, scalability, and runtime deviations. We make our benchmark suite open-source, enabling rigorous and comparable evaluations of serverless workflows over time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。