arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.11410cs.ITcs.AIcs.NImath.IT
收藏

强化学习-为6 G边缘智能提供移动边缘计算

Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge Intelligence

Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Tsinghua University(清华大学);East China Normal University(华东师范大学);Nantong University(南通大学);National Mobile Communications Research Laboratory(移动通信国家重点实验室);Southeast University(东南大学);National Key Laboratory on Communications(通信抗干扰技术国家级重点实验室);University of Electronic Science and Technology of China(电子科技大学)

Peng Wei, Kun Guo, Ye Li, Jue Wang, Wei Feng, Shi Jin, Ning Ge, Ying-Chang Liang

摘要:

移动边缘计算(MEC)被认为是第五代(5G)网络及以后的计算密集型和延迟敏感型任务的新范式。然而,由于移动终端、无线信道和边缘网络等方面的不确定性(动态性和随机性),导致了该问题的高维、非凸、非线性和NP难优化问题。由于进化的强化学习(RL),通过与动态和随机环境的迭代交互,其训练的代理可以智能地获得MEC中的最优策略。此外,它的进化版本,如深度RL(DRL),可以实现更高的收敛速度效率和学习精度的基础上的参数近似的大规模状态-动作空间。本文提供了一个全面的研究综述RL使能MEC,并提供了在这一领域的发展洞察力。更重要的是,与自由移动性,动态信道和分布式服务,MEC的挑战,可以解决不同种类的RL算法被确定,其次是他们如何可以解决RL解决方案在不同的移动应用。最后,讨论了开放的挑战,为今后的研究提供了有益的指导RL培训和学习MEC。

英文摘要:

Mobile edge computing (MEC) is considered a novel paradigm for computation-intensive and delay-sensitive tasks in fifth generation (5G) networks and beyond. However, its uncertainty, referred to as dynamic and randomness, from the mobile device, wireless channel, and edge network sides, results in high-dimensional, nonconvex, nonlinear, and NP-hard optimization problems. Thanks to the evolved reinforcement learning (RL), upon iteratively interacting with the dynamic and random environment, its trained agent can intelligently obtain the optimal policy in MEC. Furthermore, its evolved versions, such as deep RL (DRL), can achieve higher convergence speed efficiency and learning accuracy based on the parametric approximation for the large-scale state-action space. This paper provides a comprehensive research review on RL-enabled MEC and offers insight for development in this area. More importantly, associated with free mobility, dynamic channels, and distributed services, the MEC challenges that can be solved by different kinds of RL algorithms are identified, followed by how they can be solved by RL solutions in diverse mobile applications. Finally, the open challenges are discussed to provide helpful guidance for future research in RL training and learning MEC.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑