arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.08442cs.LGeess.SP
收藏

用于5G Beyond中的高能效计算卸载和资源分配的边缘智能

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

University of Electronic Science and Technology of China(电子科技大学);University of Oslo(奥斯陆大学);Simula Metropolitan Center for Digital Engineering(Simula大都会数字工程中心)

Yueyue Dai, Ke Zhang, Sabita Maharjan, Yan Zhang

摘要:

5G超越是一个端-边缘-云协调网络,可以利用终端设备、边缘服务器和云的异构功能,因此有可能通过计算卸载来实现计算密集型和延迟敏感型应用。然而,在多用户无线网络中,不同的应用需求和各种无线电接入模式的可能性,用于设备之间的通信,使得设计一个最佳的计算卸载方案具有挑战性。此外,能够访问包括诸如无线信道状态、可用带宽和计算资源等变量的完整网络信息是一个主要问题。深度强化学习(Deep Reinforcement Learning,DRL)是一种新兴技术,用于解决网络信息有限且不准确的问题。在本文中,我们利用DRL设计一个最佳的计算卸载和资源分配策略,以最小化系统的能量消耗。我们首先提出了一个多用户端-边缘-云协调网络,其中所有设备和基站都具有计算能力。然后,我们制定了联合计算卸载和资源分配问题的马尔可夫决策过程(MDP),并提出了一种新的DRL算法,以最大限度地减少系统的能量消耗。基于真实数据集的数值结果表明,所提出的基于DRL的算法显着优于基准政策的系统能耗。大量的仿真结果表明,学习率,折扣因子,和设备的数量有相当大的影响所提出的算法的性能。

英文摘要:

5G beyond is an end-edge-cloud orchestrated network that can exploit heterogeneous capabilities of the end devices, edge servers, and the cloud and thus has the potential to enable computation-intensive and delay-sensitive applications via computation offloading. However, in multi user wireless networks, diverse application requirements and the possibility of various radio access modes for communication among devices make it challenging to design an optimal computation offloading scheme. In addition, having access to complete network information that includes variables such as wireless channel state, and available bandwidth and computation resources, is a major issue. Deep Reinforcement Learning (DRL) is an emerging technique to address such an issue with limited and less accurate network information. In this paper, we utilize DRL to design an optimal computation offloading and resource allocation strategy for minimizing system energy consumption. We first present a multi-user end-edge-cloud orchestrated network where all devices and base stations have computation capabilities. Then, we formulate the joint computation offloading and resource allocation problem as a Markov Decision Process (MDP) and propose a new DRL algorithm to minimize system energy consumption. Numerical results based on a real-world dataset demonstrate that the proposed DRL-based algorithm significantly outperforms the benchmark policies in terms of system energy consumption. Extensive simulations show that learning rate, discount factor, and number of devices have considerable influence on the performance of the proposed algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑