arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.01705cs.ITcs.LGmath.IT

Faded-Experience Trust Region Policy Optimization for Model-Free Power Allocation in Interference Channel

Carleton University(卡尔顿大学)

Mohammad G. Khoshkholgh, Halim Yanikomeroglu

英文摘要:

Policy gradient reinforcement learning techniques enable an agent to directly learn an optimal action policy through the interactions with the environment. Nevertheless, despite its advantages, it sometimes suffers from slow convergence speed. Inspired by human decision making approach, we work toward enhancing its convergence speed by augmenting the agent to memorize and use the recently learned policies. We apply our method to the trust-region policy optimization (TRPO), primarily developed for locomotion tasks, and propose faded-experience (FE) TRPO. To substantiate its effectiveness, we adopt it to learn continuous power control in an interference channel when only noisy location information of devices is available. Results indicate that with FE-TRPO it is possible to almost double the learning speed compared to TRPO. Importantly, our method neither increases the learning complexity nor imposes performance loss.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑