arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2008.06905eess.SP
收藏

LTE及以上许可用户与非许可用户共存的基于DRL的QoS-Aware资源分配方案

DRL-Based QoS-Aware Resource Allocation Scheme for Coexistence of Licensed and Unlicensed Users in LTE and Beyond

Mahdi Nouri Boroujerdi, Mohammad Akbari, Roghayeh Joda, Mohammad Ali Maddah-Ali, Babak Hossein Khalaj

摘要:

在本文中,我们采用深度强化学习来开发一种新的无线电资源分配和分组调度方案,以满足适用于LTEadvanced和5G网络的不同服务质量(QoS)要求。此外,对于低于6GHz频段的频谱稀缺性,所提出的算法动态地将资源块(RB)分配给授权用户,以最大程度地保持未分配RB的连续性。这将通过增加不中断通信的机会并减少协调开销的负载来提高未许可实体之间的通信效率。该优化问题被制定为一个马尔可夫决策过程(MDP),观察整个队列的需求,其中未能满足QoS约束惩罚的目标与乘法因子。此外,未分配资源的连续性的概念被考虑作为目标函数中的附加项。考虑到信道系数和用户请求的变化,我们利用深度强化学习算法作为在线和数值有效的方法来解决MDP。数值结果表明,与传统的贪婪最小延迟和最大吞吐量方案相比,该方法在考虑延迟预算和丢包率的同时,获得了更高的平均频谱效率,在传统的贪婪最小延迟和最大吞吐量方案中,固定的频谱部分被迫为未授权实体空置。

英文摘要:

In this paper, we employ deep reinforcement learning to develop a novel radio resource allocation and packet scheduling scheme for different Quality of Service (QoS) requirements applicable to LTEadvanced and 5G networks. In addition, regarding the scarcity of spectrum in below 6GHz bands, the proposed algorithm dynamically allocates the resource blocks (RBs) to licensed users in a way to mostly preserve the continuity of unallocated RBs. This would improve the efficiency of communication among the unlicensed entities by increasing the chance of uninterrupted communication and reducing the load of coordination overheads. The optimization problem is formulated as a Markov Decision Process (MDP), observing the entire queue of the demands, where failing to meet QoS constraints penalizes the goal with a multiplicative factor. Furthermore, a notion of continuity for unallocated resources is taken into account as an additive term in the objective function. Considering the variations in both channel coefficients and users requests, we utilize a deep reinforcement learning algorithm as an online and numerically efficient approach to solve the MDP. Numerical results show that the proposed method achieves higher average spectral efficiency, while considering delay budget and packet loss ratio, compared to the conventional greedy min-delay and max-throughput schemes, in which a fixed part of the spectrum is forced to be vacant for unlicensed entities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑