arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.05063cs.MA
收藏

基于图注意力网络的密集蜂窝网络切片资源管理多智能体强化学习

Graph Attention Network-based Multi-agent Reinforcement Learning for Slicing Resource Management in Dense Cellular Network

Yan Shao, Rongpeng Li, Bing Hu, Yingxiao Wu, Zhifeng Zhao, Honggang Zhang

摘要:

网络切片(Network Slicing,NS)管理致力于在相同的物理通信基础设施上提供各种服务以满足不同的需求,并按需分配资源。考虑到密集蜂窝网络的情况下,包含多个NS在多个基站(BS),它仍然具有挑战性,设计一个合适的实时片间资源管理策略,以应付频繁的BS切换,并满足不同的业务需求的波动。在本文中,我们建议制定这个挑战作为一个多智能体强化学习(MARL)的问题,其中每个BS代表一个代理。然后,我们利用图注意力网络(GAT),以加强代理之间的时间和空间的合作。此外,我们将GAT纳入深度强化学习(DRL),并相应地设计了一个智能实时片间资源管理策略。更特别的是,我们证明了GAT的普遍有效性,在多智能体系统中,通过应用GAT的顶部的基于价值的方法深Q网络(DQN)和基于策略和基于价值的方法优势演员评论家(A2C)的组合。最后,我们通过大量的仿真验证了基于门的MARL算法的优越性。

英文摘要:

Network slicing (NS) management devotes to providing various services to meet distinct requirements over the same physical communication infrastructure and allocating resources on demands. Considering a dense cellular network scenario that contains several NS over multiple base stations (BSs), it remains challenging to design a proper real-time inter-slice resource management strategy, so as to cope with frequent BS handover and satisfy the fluctuations of distinct service requirements. In this paper, we propose to formulate this challenge as a multi-agent reinforcement learning (MARL) problem in which each BS represents an agent. Then, we leverage graph attention network (GAT) to strengthen the temporal and spatial cooperation between agents. Furthermore, we incorporate GAT into deep reinforcement learning (DRL) and correspondingly design an intelligent real-time inter-slice resource management strategy. More specially, we testify the universal effectiveness of GAT for advancing DRL in the multi-agent system, by applying GAT on the top of both the value-based method deep Q-network (DQN) and a combination of policy-based and value-based method advantage actor-critic (A2C). Finally, we verify the superiority of the GAT-based MARL algorithms through extensive simulations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑