arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.07601cs.NI
收藏

射频认知无线电网络环境下的强化学习方法

Reinforcement Learning Approach for RF-Powered Cognitive Radio Network with Ambient Backscatter

Nguyen Van Huynh, Dinh Thai Hoang, Diep N. Nguyen, Eryk Dutkiewicz, Dusit Niyato, Ping Wang

摘要:

对于具有环境反向散射能力的RF供电的认知无线电网络,当主信道繁忙时,RF供电的次级用户(RSU)可以反向散射主信号以发送其自己的数据或从主信号中获取能量(并存储在其电池中)。然后,当主信道变为空闲时,可以使用所收获的能量来发送数据。为了最大化二次系统的吞吐量,RSU决定何时反向散射以及何时收集能量至关重要。这种最佳决策必须考虑主信道的动态、能量存储能力和要发送的数据。为了解决这个问题,我们提出了一个基于马尔可夫决策过程(MDP)的框架,以优化RSU的决策基于其当前状态,例如,能量、数据以及主信道状态。由于状态信息可能不容易在RSU,我们然后设计了一个低复杂度的在线强化学习算法,引导RSU找到最佳的解决方案,而不需要事先和完整的环境信息。大量的仿真结果清楚地表明,所提出的解决方案实现了更高的吞吐量,即,50%以上,比传统的方法。

英文摘要:

For an RF-powered cognitive radio network with ambient backscattering capability, while the primary channel is busy, the RF-powered secondary user (RSU) can either backscatter the primary signal to transmit its own data or harvest energy from the primary signal (and store in its battery). The harvested energy then can be used to transmit data when the primary channel becomes idle. To maximize the throughput for the secondary system, it is critical for the RSU to decide when to backscatter and when to harvest energy. This optimal decision has to account for the dynamics of the primary channel, energy storage capability, and data to be sent. To tackle that problem, we propose a Markov decision process (MDP)-based framework to optimize RSU's decisions based on its current states, e.g., energy, data as well as the primary channel state. As the state information may not be readily available at the RSU, we then design a low-complexity online reinforcement learning algorithm that guides the RSU to find the optimal solution without requiring prior- and complete-information from the environment. The extensive simulation results then clearly show that the proposed solution achieves higher throughputs, i.e., up to 50%, than that of conventional methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑