Interference among concurrent transmissions in a wireless network is a key factor limiting the system performance. One way to alleviate this problem is to manage the radio resources in order to maximize either the average or the worst-case performance. However, joint consideration of both metrics is often neglected as they are competing in nature. In this article, a mechanism for radio resource management using multi-agent deep reinforcement learning (RL) is proposed, which strikes the right trade-off between maximizing the average and the $5^{th}$ percentile user throughput. Each transmitter in the network is equipped with a deep RL agent, receiving partial observations from the network (e.g., channel quality, interference level, etc.) and deciding whether to be active or inactive at each scheduling interval for given radio resources, a process referred to as link scheduling. Based on the actions of all agents, the network emits a reward to the agents, indicating how good their joint decisions were. The proposed framework enables the agents to make decisions in a distributed manner, and the reward is designed in such a way that the agents strive to guarantee a minimum performance, leading to a fair resource allocation among all users across the network. Simulation results demonstrate the superiority of our approach compared to decentralized baselines in terms of average and $5^{th}$ percentile user throughput, while achieving performance close to that of a centralized exhaustive search approach. Moreover, the proposed framework is robust to mismatches between training and testing scenarios. In particular, it is shown that an agent trained on a network with low transmitter density maintains its performance and outperforms the baselines when deployed in a network with a higher transmitter density.
Radio Resource Management and Path Planning in Intelligent Transportation Systems via Reinforcement Learning for Environmental Sustainability
Tarbiat Modares University(塔比亚特·莫达雷斯大学);Doha University for Science and Technology(多哈科技大学);TU Braunschweig(布伦瑞克工业大学);Institute of Communications Technology(通信技术研究所)
Green Deep Reinforcement Learning for Radio Resource Management: Architecture, Algorithm Compression and Challenge
National University of Defense Technology(中国人民解放军国防科技大学);Kings College London(伦敦国王学院);Cranfield University(克兰菲尔德大学);Alan Turing Institute(艾伦·图灵研究所);Queen Mary University of London(伦敦玛丽女王大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学)
Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical Analysis
Hong Kong University of Science and Technology(香港科技大学);Peng Cheng Lab(鹏城实验室);ShanghaiTech University(上海科技大学);The Hong Kong Polytechnic University(香港理工大学)
Clustered Scheduling and Communication Pipelining For Efficient Resource Management Of Wireless Federated Learning
Texas A&M University(德克萨斯农工大学);Texas A&M University at Qatar(德克萨斯农工大学卡塔尔分校);Qatar Foundation Research, Development and Innovation RDI(卡塔尔基金会研究、开发与创新(RDI));Tennessee Tech University(田纳西理工大学)
Smart energy management: process structure-based hybrid neural networks for optimal scheduling and economic predictive control in integrated systems
School of Energy and Environment, Southeast University(能源与环境学院,东南大学);Department of Chemical & Materials Engineering, University of Alberta(阿尔伯塔大学化学与材料工程系);School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University(南洋理工大学化学、化学工程与生物技术学院)
Bayesian Optimization for Non-Cooperative Game-Based Radio Resource Management
School of Information Engineering, Wuhan University of Technology, Wuhan, China(信息工程学院,武汉理工大学,武汉);Department of Engineering, King's College London, London, UK(工程系,伦敦国王学院,伦敦);School of Electronic Information and Communications, Huazhong University of Science(电子信息与通信学院,华中科技大学)