UAV-Assisted Resilience in 6G and Beyond Network Energy Saving: A Multi-Agent DRL Approach
National Economics University(国立经济大学);Norwegian University of Science and Technology(挪威科技大学);Waseda University(早稻田大学);Duy Tan University(杜维谭大学);University of Luxembourg(卢森堡大学);National Academy of Education Management(国家教育管理学院)
Dao Lan Vy Dinh, Anh Nguyen Thi Mai, Hung Tran, Giang Quynh Le Vu, Tu Dac Ho, Zhenni Pan, Vo Nhan Van, Symeon Chatzinotas, Dinh-Hieu Tran
This paper investigates the unmanned aerial vehicle (UAV)-assisted resilience perspective in the 6G network energy saving (NES) scenario. More specifically, we consider multiple ground base stations (GBSs) and each GBS has three different sectors/cells in the terrestrial networks, and multiple cells may become inactive due to unexpected events such as power outages, disasters, hardware failures, or erroneous energy-saving decisions made by external network management systems. During the time required to reactivate these cells, UAVs are deployed to temporarily restore user service. To address this, we propose a Multi-Agent Deep Deterministic Policy Gradient (MADDPG) framework to enable UAV-assisted communication by jointly optimizing UAV trajectories, transmission power, and user-UAV association under a sleeping ground base station (GBS) strategy. This framework aims to ensure the resilience of active users in the network and the long-term operability of UAVs. Specifically, it maximizes service coverage for users during power outages or NES zones, while minimizing the energy consumption of UAVs. Simulation results demonstrate that the proposed MADDPG policy consistently achieves high coverage ratio across different testing episodes, outperforming other baselines. Moreover, the MADDPG framework attains the lowest total energy consumption, while maintaining a comparable user service rate. These results confirm the effectiveness of the proposed approach in achieving a superior trade-off between energy efficiency and service performance, supporting the development of sustainable and resilient UAV-assisted cellular networks.
Transfer learning-enhanced deep reinforcement learning for aerodynamic airfoil optimisation subject to structural constraints
ETSIAE-UPM-School of Aeronautics, Universidad Politécnica de Madrid, Plaza Cardenal Cisneros 3, E-28040 Madrid, Spain(西班牙马德里理工大学航空航天学院);Institute for Cross-Disciplinary Physics(跨学科物理研究所);Center for Computational Simulation, Universidad Politécnica de Madrid, Campus de Montegancedo, Boadilla del Monte, 28660 Madrid, Spain(马德里理工大学计算仿真中心)
Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approach
AImotion Bavaria, Technische Hochschule Ingolstadt(巴伐利亚AImotion、英格尔施泰特技术大学);School of Computation, Information and Technology, TU Munich(计算、信息与技术学院,慕尼黑技术大学)
Multi-Agent DRL for Queue-Aware Task Offloading in Hierarchical MEC-Enabled Air-Ground Networks
Hamad Bin Khalifa University(哈马德·本·哈利法大学);College of Science and Engineering(科学与工程学院);Division of Information and Computing Technology(信息与计算技术系);College of Engineering, Qatar University(卡塔尔大学工程学院)
Enhancing Cyber-Resilience in Integrated Energy System Scheduling with Demand Response Using Deep Reinforcement Learning
School of Electrical Engineering, Northeast Electric Power University(东北电力大学电气工程学院);State Grid XiXian New Area Power Supply Company(国家电网西安新区供电公司);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院);The Hong Kong University of Science and Technology(香港科技大学);Institute of Energy Technology, Aalborg University(奥尔堡大学能源技术研究所);Illinois Institute of Technology(伊利诺伊理工大学)
Resilient Load Restoration in Microgrids Considering Mobile Energy Storage Fleets: A Deep Reinforcement Learning Approach
Interdisciplinary Graduate School, Nanyang Technological University Singapore(南洋理工大学跨学科研究生院(新加坡));School of Electrical and Electronic Engineering, Nanyang Technological University Singapore(南洋理工大学电气与电子工程学院(新加坡))
AI-Driven Green Cognitive Radio Networks for Sustainable 6G Communication
Liverpool John Moores University(利物浦约翰摩尔斯大学);University Institute of Computing(计算大学学院);Chandigarh University(昌迪加尔大学);Gyancity Research Consultancy(Gyancity研究咨询公司)
Improving the Efficiency of a Deep Reinforcement Learning-Based Power Management System for HPC Clusters Using Curriculum Learning
Department of Computer Science and Electronics, Universitas Gadjah Mada(加雅达大学计算机科学与电子系);Cyberscience Center, Tohoku University(东大网络科学中心);Department of Industrial Management, National Taiwan University of Science and Technology(台湾科技大学工业管理系)
Maintenance Strategies for Sewer Pipes with Multi-State Degradation and Deep Reinforcement Learning
Ruhr-University Bochum(波鸿鲁尔大学);University of Twente(特温特大学);Eindhoven University of Technology(埃因霍温理工大学);Rolsch Assetmanagement(罗尔施资产管理公司);Radboud University(拉德堡德大学)
Tackling Snow-Induced Challenges: Safe Autonomous Lane-Keeping with Robust Reinforcement Learning
Department of Electrical Engineering, Amirkabir University of Technology(电气工程系,阿米尔卡比尔技术大学);Department of Mechanical Engineering, Amirkabir University of Technology(机械工程系,阿米尔卡比尔技术大学)
TDC-Cache: A Trustworthy Decentralized Cooperative Caching Framework for Web3.0
School of Electronic and Optical Engineering, Nanjing University of Science and Technology(南京理工大学电子与光学工程学院);College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);National Mobile Communications Research Laboratory, Southeast University(东南大学国家移动通信研究中心);Purple Mountain Laboratories(紫金山实验室);School of Electrical Engineering and Telecommunications, The University of New South Wales(新南威尔士大学电子与电信工程学院)
SCOPE: Deterministic and Training-Free 3D UAV Deployment via Perimeter-based Heuristics
National Chung Cheng University(中正大学);Advanced Institute of Manufacturing with High-tech Innovations (AIM-HI), National Chung Cheng University(中正大学先进制造与高科技创新研究院)