arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.12134cs.ITmath.IT
收藏

F-RAN与D2D通信中用于和速率最大化的联合强化学习使能缓存和跨层网络码

A Joint Reinforcement-Learning Enabled Caching and Cross-Layer Network Code for Sum-Rate Maximization in F-RAN with D2D Communications

Mohammed S. Al-Abiad, Md. Zoheb Hassan, Md. Jahangir Hossain

摘要:

在本文中,我们利用强化学习(RL)和跨层网络编码(CLNC)有效地预取用户的内容到本地缓存,并将这些内容提供给用户在下行链路雾无线接入网络(F-RAN)与设备到设备(D2 D)通信。在所考虑的系统中,雾接入点(F-AP)和缓存使能的D2 D(CE-D2 D)用户配备有本地缓存,以减轻在前传的流量负担,而用户的内容可以很容易地和快速地容纳。在CLNC中,编码决策考虑用户的内容、其速率以及F-AP和CE-D2 D用户的功率水平,并且RL优化缓存策略。为了实现这一目标,一个联合内容放置和交付问题制定为一个优化问题的目标,以最大限度地提高系统的总和率。对于这个NP难题,我们首先开发了一种创新的分散式CLNC联盟形成(CLNC-CF)算法,以获得内容交付问题的稳定解决方案,其中F-AP和CE-D2 D用户利用CLNC资源分配。通过考虑F-AP和CE-D2 D用户的行为,我们开发了一种多代理RL(MARL)算法,用于优化F-AP和CE-D2 D用户的内容放置。仿真结果表明,与最优未编码算法、标准速率感知NC算法和网络层优化的基准经典NC算法相比,联合CLNC-CF和RL框架可以有效地提高和速率,分别提高30%、60%和150%.

英文摘要:

In this paper, we leverage reinforcement learning (RL) and cross-layer network coding (CLNC) for efficiently pre-fetching users' contents to the local caches and delivering these contents to users in a downlink fog-radio access network (F-RAN) with device-to-device (D2D) communications. In the considered system, fog access points (F-APs) and cache-enabled D2D (CE-D2D) users are equipped with local caches for alleviating traffic burden at the fronthaul, while users' contents can be easily and quickly accommodated. In CLNC, the coding decisions take users' contents, their rates, and power levels of F-APs and CE-D2D users into account, and RL optimizes caching strategy. Towards this goal, a joint content placement and delivery problem is formulated as an optimization problem with a goal to maximize system sum-rate. For this NP-hard problem, we first develop an innovative decentralized CLNC coalition formation (CLNC-CF) algorithm to obtain a stable solution for the content delivery problem, where F-APs and CE-D2D users utilize CLNC resource allocation. By taking the behavior of F-APs and CE-D2D users into account, we then develop a multi-agent RL (MARL) algorithm for optimizing the content placements at both F-APs and CE-D2D users. Simulation results show that the proposed joint CLNC-CF and RL framework can effectively improve the sum-rate by up to 30\%, 60\%, and 150\%, respectively, compared to: 1) an optimal uncoded algorithm, 2) a standard rate-aware-NC algorithm, and 3) a benchmark classical NC with network-layer optimization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑