Metaverse is expected to create a virtual world closely connected with reality to provide users with immersive experience with the support of 5G high data rate communication technique. A huge amount of data in physical world needs to be synchronized to the virtual world to provide immersive experience for users, and there will be higher requirements on coverage to include more users into Metaverse. However, 5G signal suffers severe attenuation, which makes it more expensive to maintain the same coverage. Unmanned aerial vehicle (UAV) is a promising candidate technique for future implementation of Metaverse as a low-cost and high-mobility platform for communication devices. In this paper, we propose a proximal policy optimization (PPO) based double-agent cooperative reinforcement learning method for channel allocation and trajectory control of UAV to collect and synchronize data from the physical world to the virtual world, and expand the coverage of Metaverse services economically. Simulation results show that our proposed method is able to achieve better performance compared to the benchmark approaches.
Graph Neural Network Aided Deep Reinforcement Learning for Resource Allocation in Dynamic Terahertz UAV Networks
Terahertz Wireless Communications (TWC) Laboratory, Shanghai Jiao Tong University(太赫兹无线通信实验室,上海交通大学);Cooperative Medianet Innovation Center (CMIC), School of Information Science and Electronic Engineering, Shanghai Jiao Tong University(协同中继网络创新中心,信息科学与电子工程学院,上海交通大学)
TRUAV: Distributed Multi-Agent Reinforcement Learning for Trajectory Planning and Routing Enhancement in UAV-Aided IoT-Enabled VANETs
Hangzhou International Innovation Institute of Beihang University(北京航空航天大学杭州国际创新研究院);School of Automation Science and Electrical Engineering at Beihang University(北京航空航天大学自动化科学与电气工程学院);State Key Laboratory of Intelligent Manufacturing Systems Technology(智能制造系统技术国家重点实验室);School of Transportation, Southeast University(东南大学交通学院);Digital Health Research Center, Haihe Lab of ITAI(海河信息技术与人工智能实验室数字健康研究中心);School of Cyber Science, Nankai University(南开大学网络空间科学学院);China-SCO Digital Intelligence Applications (DIA) Joint Laboratory(中国-上海合作组织数字智能应用联合实验室);College of Engineering, Abu Dhabi University(阿布扎比大学工程学院);Faculty of Engineering and Architecture, Nisantasi University(尼桑塔西大学工程与建筑学院);School of Information Engineering, Guangdong University of Technology(广东工业大学信息工程学院)
Optimizing Energy and Data Collection in UAV-aided IoT Networks using Attention-based Multi-Objective Reinforcement Learning
Advanced Wireless Technology Lab, Paris Research Center, Huawei Technologies France(华为法国技术有限公司巴黎研究中心先进无线技术实验室);EURECOM, Sophia Antipolis, France(埃鲁科姆法国索菲亚安蒂波利斯分部);Communication Systems Department, EURECOM, Sophia Antipolis, France(埃鲁科姆法国索菲亚安蒂波利斯分部通信系统部);Dept. of Computer Science and Artificial Intelligence, University of Granada, Spain(Granada大学计算机科学与人工智能系)
Efficient Trajectory Design and Communication Scheduling for Dual-UAV Jamming-Aided Secure Communication Networks
School of Electronic Information, Wuhan University(武汉大学电子信息学院);Chair of Information Theory and Data Analytics, RWTH Aachen University(亚琛工业大学信息理论与数据分析讲席)