arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.07144cs.ITcs.AImath.IT
收藏

基于多智能体强化学习的无线MAC协议的出现

The Emergence of Wireless MAC Protocols with Multi-Agent Reinforcement Learning

Nokia Bell Labs(诺基亚贝尔实验室);National Institute of Applied Sciences(法国国立应用科学学院);NVIDIA(英伟达)

Mateus P. Mota, Alvaro Valcarce, Jean-Marie Gorce, Jakob Hoydis

摘要:

在本文中,我们提出了一个新的框架,利用多代理深度确定性策略梯度(MADDPG)算法,使基站(BS)和用户设备(UE)拿出一个介质访问控制(MAC)协议在多址接入的情况下。在该框架中,BS和UE是强化学习(RL)代理,其需要学习协作以便递送数据。网络节点可以交换控制消息以在网络上协作和传递数据,但无需事先就控制消息的含义达成任何协议。在这样的框架中,代理不仅要学习信道访问策略,而且要学习信令策略。代理之间的合作被证明是重要的,通过比较所提出的算法消融版本,无论是代理之间的通信或中央批评被删除。与无争用基线的比较表明,我们的框架在有效吞吐量方面取得了优异的性能,可以有效地用于学习新协议。

英文摘要:

In this paper, we propose a new framework, exploiting the multi-agent deep deterministic policy gradient (MADDPG) algorithm, to enable a base station (BS) and user equipment (UE) to come up with a medium access control (MAC) protocol in a multiple access scenario. In this framework, the BS and UEs are reinforcement learning (RL) agents that need to learn to cooperate in order to deliver data. The network nodes can exchange control messages to collaborate and deliver data across the network, but without any prior agreement on the meaning of the control messages. In such a framework, the agents have to learn not only the channel access policy, but also the signaling policy. The collaboration between agents is shown to be important, by comparing the proposed algorithm to ablated versions where either the communication between agents or the central critic is removed. The comparison with a contention-free baseline shows that our framework achieves a superior performance in terms of goodput and can effectively be used to learn a new protocol.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑