arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.00514cs.NI
收藏

基于深度强化学习的移动边缘计算性能优化

Performance Optimization in Mobile-Edge Computing via Deep Reinforcement Learning

Xianfu Chen, Honggang Zhang, Celimuge Wu, Shiwen Mao, Yusheng Ji, Mehdi Bennis

摘要:

为了提高移动设备的计算体验的质量,移动边缘计算(MEC)通过在邻近的无线电接入网络内提供计算能力而成为一种有前途的范例。然而,MEC系统的计算卸载策略的设计仍然具有挑战性。具体地,是在本地移动终端执行到达的计算任务还是卸载任务以用于云执行,应该以更智能的方式适应环境动态。在本文中,我们认为MEC的一个代表性的移动用户在一个超密集的网络,其中多个基站(BS)之一,可以选择计算卸载。求解最优计算卸载策略的问题被建模为马尔可夫决策过程,其中我们的目标是最小化的长期成本和卸载决策是基于移动用户和BS之间的信道质量,能量队列状态以及任务队列状态。为了打破状态空间中高维的诅咒,我们提出了一种基于深度$Q$网络的策略计算卸载算法来学习最优策略,而无需动态统计的先验知识。数值实验结果表明,与基准策略相比,该算法在平均代价上有了显著的提高。

英文摘要:

To improve the quality of computation experience for mobile devices, mobile-edge computing (MEC) is emerging as a promising paradigm by providing computing capabilities within radio access networks in close proximity. Nevertheless, the design of computation offloading policies for a MEC system remains challenging. Specifically, whether to execute an arriving computation task at local mobile device or to offload a task for cloud execution should adapt to the environmental dynamics in a smarter manner. In this paper, we consider MEC for a representative mobile user in an ultra dense network, where one of multiple base stations (BSs) can be selected for computation offloading. The problem of solving an optimal computation offloading policy is modelled as a Markov decision process, where our objective is to minimize the long-term cost and an offloading decision is made based on the channel qualities between the mobile user and the BSs, the energy queue state as well as the task queue state. To break the curse of high dimensionality in state space, we propose a deep $Q$-network-based strategic computation offloading algorithm to learn the optimal policy without having a priori knowledge of the dynamic statistics. Numerical experiments provided in this paper show that our proposed algorithm achieves a significant improvement in average cost compared with baseline policies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑