Humas:大规模数据中心中面向异构性与升级感知的微服务自动扩缩容框架
Humas: A Heterogeneity- and Upgrade-aware Microservice Auto-scaling Framework in Large-scale Data Centers
AI总结:
针对大规模微服务性能模式刻画中异构机器差异与升级漂移的挑战,提出Humas自动扩缩容框架,通过资源归一化、LSDD漂移识别与容量调整,显著提升资源效率与性能稳定性。
摘要:
有效的自动扩缩容框架对于微服务在动态工作负载下保障性能稳定性与资源效率至关重要。正如诸多先前研究揭示的,高效自动扩缩容的关键在于准确学习性能模式,即数据驱动方案中性能指标与工作负载之间的关系。然而我们注意到,在刻画大规模微服务的性能模式时存在两大显著挑战。首先,不同微服务对异构机器表现出不同的敏感度,导致难以用固定方式量化性能差异。其次,微服务的频繁版本升级会引发性能模式的不确定变化(即模式漂移),导致资源容量估计不精确的问题。为应对这些挑战,我们提出Humas——一种面向大规模微服务的异构性与升级感知自动扩缩容框架。首先,Humas在线量化异构机器间针对不同微服务的资源效率差异,并以标准单位归一化其资源。此外,Humas开发了基于最小二乘密度差(LSDD)的算法来识别由升级引发的模式漂移。最后,Humas基于最新的性能模式与预测的工作负载为微服务生成容量调整方案。在50个真实微服务、超11000个容器上开展的实验结果表明,与现有最优方法相比,Humas将资源效率与性能稳定性分别提升了约30.4%和48.0%。
英文摘要:
An effective auto-scaling framework is essential for microservices to ensure performance stability and resource efficiency under dynamic workloads. As revealed by many prior studies, the key to efficient auto-scaling lies in accurately learning performance patterns, i.e., the relationship between performance metrics and workloads in data-driven schemes. However, we notice that there are two significant challenges in characterizing performance patterns for large-scale microservices. Firstly, diverse microservices demonstrate varying sensitivities to heterogeneous machines, causing difficulty in quantifying the performance difference in a fixed manner. Secondly, frequent version upgrades of microservices result in uncertain changes in performance patterns, known as pattern drifts, leading to imprecise resource capacity estimation issues. To address these challenges, we propose Humas, a heterogeneity- and upgrade-aware auto-scaling framework for large-scale microservices. Firstly, Humas quantifies the difference in resource efficiency among heterogeneous machines for various microservices online and normalizes their resources in standard units. Additionally, Humas develops a least squares density-difference (LSDD) based algorithm to identify pattern drifts caused by upgrades. Lastly, Humas generates capacity adjustment plans for microservices based on the latest performance patterns and predicted workloads. The experiment results conducted on 50 real microservices with over 11,000 containers demonstrate that Humas improves resource efficiency and performance stability by approximately 30.4% and 48.0%, respectively, compared to state-of-the-art approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。