arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.09290cs.NIcs.LG
收藏

基于约束强化学习的5G切片可泛化资源伸缩

Generalizable Resource Scaling of 5G Slices using Constrained Reinforcement Learning

University of Waterloo(滑铁卢大学);Rogers Communications Inc.(罗杰斯通信公司)

Muhammad Sulaiman, Mahdieh Ahmadi, Mohammad A. Salahuddin, Raouf Boutaba, Aladdin Saleh

AI总结:

针对5G切片资源分配中QoS与资源关系复杂、现有方法泛化性差的问题,提出基于回归模型与域随机化离线训练的风险约束强化学习方法,实现可泛化的资源动态伸缩,在未知流量下将QoS下降控制在10%阈值内且最小化资源占用。

摘要:

网络切片是5G支撑各类应用的关键使能技术。服务提供商(SP)请求的切片具有异构的服务质量(QoS)需求,例如时延、吞吐量和抖动。5G基础设施提供商(InP)必须根据切片流量分配适量资源,从而在切片生命周期内维持指定的QoS水平,同时最大化资源效率。然而,QoS与资源分配之间存在复杂的非线性关系。本文采用基于回归的模型学习该关系,还利用一种风险约束强化学习智能体,该智能体借助上述模型和域随机化进行离线训练,用于动态伸缩切片资源同时维持预期QoS水平。我们的新方法因属于无模型方法、且无需将QoS指标以流量为变量进行数学公式化,因而降低了网络建模误差的影响。此外,该方法对不确定的网络状况具备鲁棒性,可泛化到不同的真实流量模式,且能适配多种QoS指标。结果表明,在未见过的流量上测试时,现有最优方法会导致高达44.5%的QoS下降。相比之下,我们的方法在此类流量下将QoS下降维持在预设的10%阈值以下,同时最小化分配的资源。此外,我们证明所提方法对变化的网络状况和不准确的流量预测均具备鲁棒性。

英文摘要:

Network slicing is a key enabler for 5G to support various applications. Slices requested by service providers (SPs) have heterogeneous quality of service (QoS) requirements, such as latency, throughput, and jitter. It is imperative that the 5G infrastructure provider (InP) allocates the right amount of resources depending on the slice's traffic, such that the specified QoS levels are maintained during the slice's lifetime while maximizing resource efficiency. However, there is a non-trivial relationship between the QoS and resource allocation. In this paper, this relationship is learned using a regression-based model. We also leverage a risk-constrained reinforcement learning agent that is trained offline using this model and domain randomization for dynamically scaling slice resources while maintaining the desired QoS level. Our novel approach reduces the effects of network modeling errors since it is model-free and does not require QoS metrics to be mathematically formulated in terms of traffic. In addition, it provides robustness against uncertain network conditions, generalizes to different real-world traffic patterns, and caters to various QoS metrics. The results show that the state-of-the-art approaches can lead to QoS degradation as high as 44.5% when tested on previously unseen traffic. On the other hand, our approach maintains the QoS degradation below a preset 10% threshold on such traffic, while minimizing the allocated resources. Additionally, we demonstrate that the proposed approach is robust against varying network conditions and inaccurate traffic predictions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑