arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1902.09696cs.NIcs.AI
收藏

基于深度决斗神经网络的最优快速实时的资源切片

Optimal and Fast Real-time Resources Slicing with Deep Dueling Neural Networks

University of Technology Sydney(悉尼科技大学)

Nguyen Van Huynh, Dinh Thai Hoang, Diep N. Nguyen, Eryk Dutkiewicz

摘要:

有效的网络切片要求基础设施/网络提供商处理网络资源请求的不确定需求和实时的【形】动态。另一个挑战是众多资源的组合优化,无线电、计算机和存储。本文提出了一种最优的、快速的实时的【形】资源切片框架,该框架在考虑租户资源需求不确定性的同时,最大化网络提供商的长期回报。具体来说,我们首先提出了一种新的系统模型,使网络提供商能够有效地切片不同类型的资源,不同类别的用户在单独的虚拟切片。然后,我们捕捉实时的【形】到达的切片请求的半马尔可夫决策过程。为了在切片请求的动态下获得最优资源分配策略,例如,在服务时间和资源需求不确定的情况下,文献中经常采用Q-学习算法。然而,这样的算法是臭名昭著的收敛速度慢,特别是对于大的状态/动作空间的问题。这使得Q学习实际上不适用于我们同时优化多个资源的情况。为了解决这个问题,我们提出了一种新的网络切片方法,该方法具有先进的深度学习架构,称为深度决斗,它比传统的Q-学习算法更快地获得最佳平均奖励。该属性对于处理实时的【形】资源请求和用户的动态需求是特别期望的。大量的模拟表明,与最先进的网络切片方法相比,所提出的框架产生了高达40%的长期平均回报,同时速度快了几千倍。

英文摘要:

Effective network slicing requires an infrastructure/network provider to deal with the uncertain demand and real-time dynamics of network resource requests. Another challenge is the combinatorial optimization of numerous resources, e.g., radio, computing, and storage. This article develops an optimal and fast real-time resource slicing framework that maximizes the long-term return of the network provider while taking into account the uncertainty of resource demand from tenants. Specifically, we first propose a novel system model which enables the network provider to effectively slice various types of resources to different classes of users under separate virtual slices. We then capture the real-time arrival of slice requests by a semi-Markov decision process. To obtain the optimal resource allocation policy under the dynamics of slicing requests, e.g., uncertain service time and resource demands, a Q-learning algorithm is often adopted in the literature. However, such an algorithm is notorious for its slow convergence, especially for problems with large state/action spaces. This makes Q-learning practically inapplicable to our case in which multiple resources are simultaneously optimized. To tackle it, we propose a novel network slicing approach with an advanced deep learning architecture, called deep dueling that attains the optimal average reward much faster than the conventional Q-learning algorithm. This property is especially desirable to cope with real-time resource requests and the dynamic demands of users. Extensive simulations show that the proposed framework yields up to 40% higher long-term average return while being few thousand times faster, compared with state of the art network slicing approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑