STARIXNet: 云平台中多变量多属性深度学习方法实现实时资源分配
STARIXNet: Multivariate and Multi-attribute Deep Learning Approach to Real-Time Resource Allocation in Cloud Platforms
AI总结:
提出STARIXNet轻量神经网络,通过捕获多系统指标的时空关系进行多变量资源分配,优先服务稳定性再考虑成本效率,在沃尔玛生产环境中节省10%-50%成本。
摘要:
云平台中微服务的智能伸缩对于缓解不断增长的计算成本同时避免服务中断至关重要。当前解决方案局限于单变量空间,通常仅关注CPU使用率来驱动伸缩决策。此外,它们将问题视为纯预测任务,专注于预测精度而忽略了低估和系统响应延迟的更大风险。替代方案计算复杂,使其难以用于大规模实时部署。为应对这些挑战,我们提出STARIXNet,一种轻量级神经网络,通过捕获多个系统指标间的时空关系,在多变量空间中指导资源分配决策。STARIXNet对多个准依赖属性进行建模,特别是(S)季节性、(T)时间性、(A)自回归(I)综合和(e)外生模式,然后实施聚合策略以最终确定伸缩决策,优先考虑服务稳定性,其次是成本效率,而非原始预测准确性。我们通过在真实环境中与现有解决方案进行基准测试,实证展示了STARIXNet的性能。STARIXNet已部署于沃尔玛的关键生产微服务,实现了10%至50%的实际节省,此外还通过改善服务稳定性和客户体验带来了无形收益。
英文摘要:
Intelligent scaling of microservices in cloud platforms is crucial for mitigating escalating compute costs while avoiding service disruptions. Current solutions are limited to the univariate space, typically focusing on CPU usage alone to drive scaling decisions. Moreover, they address the problem as a purely forecasting task, focusing on prediction precision while neglecting the greater risks of underestimation and delays in system responsiveness. Alternative solutions are computationally complex, making them impractical for large-scale, real-time deployments. To address these challenges, we present STARIXNet, a lightweight neural network that guides resource allocation decisions in the multivariate space by capturing spatio-temporal relationships among multiple system metrics. STARIXNet models multiple quasi-dependent attributes, in particular the (S)easonal, (T)emporal, (A)uto-(R)egressive (I)ntegrated, and e(X)ogenous patterns, then implements an aggregation policy to finalize scaling decisions, prioritizing service stability, followed by cost-efficiency, over raw forecast accuracy. We empirically demonstrate the performance of STARIXNet by benchmarking against existing solutions in real-world settings. STARIXNet is deployed for critical production microservices at Walmart achieving tangible savings ranging from 10\% to 50\%, in addition to intangible benefits through improved service stability and customer experience.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。