arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.01000cs.LG
收藏

基于层次多指标预测与贝叶斯决策的自适应两阶段云资源伸缩

Adaptive Two-Stage Cloud Resource Scaling via Hierarchical Multi-Indicator Forecasting and Bayesian Decision-Making

Shanghai Jiao Tong Uni.(上海交通大学);AntGroup(蚂蚁集团)

Yang Luo, Shiyu Wang, Zhemeng Yu, Wei Lu, Xiaofeng Gao, Lintao Ma, Guihai Chen

AI总结:

针对云资源利用率低的问题,提出HARMONY系统,通过层次注意力多指标分布预测与不确定性感知贝叶斯决策实现自适应伸缩,在多个数据集上超越九种方法,并在真实部署中节省超3.5万GPU小时和10万美元以上成本。

摘要:

受复杂大规模模型和数据中心快速增长的推动,云计算资源需求激增,凸显了高效自适应资源分配的关键重要性。尽管大型科技企业部署了包含数千个GPU的大规模基础设施,现有云平台仍因关键挑战而面临资源利用率低下的问题:难以捕捉层次化指标结构、难以建模非高斯分布以及在不确定性下进行决策。为应对这些挑战,我们提出了HRAMONY,一个自适应的基于层次注意力的资源建模与决策系统。HARMONY结合了层次多指标分布预测和不确定性感知的贝叶斯决策。它引入了一种新颖的层次注意力机制,能够全面建模复杂的指标间依赖关系,从而实现可适应不断变化环境状态的准确预测。通过归一化流将高斯投影转化为自适应非高斯分布。至关重要的是,HARMONY在自适应贝叶斯过程中利用完整的预测分布,主动纳入不确定性以优化资源分配,同时在变化条件下稳健地满足SLA约束。在四个大规模云数据集上的广泛评估证明了HARMONY的最先进性能,显著优于九种已有方法。为期一个月的真实世界部署验证了HARMONY的显著实际影响,实现了超过35,000个GPU小时的节省,并转化为超过10万美元的成本降低,展示了其通过自适应、不确定性感知的伸缩所带来的显著经济价值。我们的代码可在https://github.com/Floating-LY/HARMONY1获取。

英文摘要:

The surging demand for cloud computing resources, driven by the rapid growth of sophisticated large-scale models and data centers, underscores the critical importance of efficient and adaptive resource allocation. As major tech enterprises deploy massive infrastructures with thousands of GPUs, existing cloud platforms still struggle with low resource utilization due to key challenges: capturing hierarchical indicator structures, modeling non-Gaussian distributions, and decision-making under uncertainty. To address these challenges, we propose HRAMONY, an adaptive Hierarchical Attention-based Resource Modeling and Decision-Making System. HARMONY combines hierarchical multi-indicator distribution forecasting and uncertainty-aware Bayesian decision-making. It introduces a novel hierarchical attention mechanism that comprehensively models complex inter-indicator dependencies, enabling accurate predictions that can adapt to evolving environment states. By transforming Gaussian projections into adaptive non-Gaussian distributions via Normalizing Flows. Crucially, HARMONY leverages the full predictive distributions in an adaptive Bayesian process, proactively incorporating uncertainties to optimize resource allocation while robustly meeting SLA constraints under varying conditions. Extensive evaluations across four large-scale cloud datasets demonstrate HARMONY's state-of-the-art performance, significantly outperforming nine established methods. A month-long real-world deployment validated HARMONY's substantial practical impact, realizing over 35,000 GPU hours in savings and translating to $100K+ in cost reduction, showcasing its remarkable economic value through adaptive, uncertainty-aware scaling. Our code is available at https://github.com/Floating-LY/HARMONY1.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑