arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.11277eess.SPcs.LG
收藏

基于多Agent深度强化学习的多无人机辅助移动边缘计算轨迹规划

Multi-Agent Deep Reinforcement Learning Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing

Department of Computer and Information Science, Northumbria University(诺森比亚大学计算机与信息科学系);School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦玛丽女王大学电子工程与计算机科学学院);National Mobile Communications Research Lab, Southeast University(东南大学国家移动通信研究实验室);Purple Mountain Laboratories(紫金山实验室);School of Electronics and Computer Science, University of Southampton(南安普顿大学电子与计算机科学学院)

Liang Wang, Kezhi Wang, Cunhua Pan, Wei Xu, Nauman Aslam, Lajos Hanzo

摘要:

提出了一种无人机辅助的移动边缘计算框架,其中多个具有不同轨迹的无人机在目标区域上空飞行并支持地面上的用户设备。我们的目标是联合优化所有UE之间的地理公平性,每个UAV的UE负载的公平性和UE的整体能耗。上述优化问题既包含整数变量又包含连续变量,求解起来具有挑战性。为了解决上述问题,提出了一种基于多智能体深度强化学习的轨迹控制算法,用于独立管理每个无人机的轨迹,其中应用了流行的多智能体深度确定性策略梯度(MADDPG)方法。给定UAV的轨迹,引入低复杂度方法以用于优化UE的卸载决策。我们表明,我们提出的解决方案具有相当大的性能比其他传统算法,无论是在公平性服务UE,公平性的UE负载在每个无人机和所有的UE的能量消耗。

英文摘要:

An unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) framework is proposed, where several UAVs having different trajectories fly over the target area and support the user equipments (UEs) on the ground. We aim to jointly optimize the geographical fairness among all the UEs, the fairness of each UAV' UE-load and the overall energy consumption of UEs. The above optimization problem includes both integer and continues variables and it is challenging to solve. To address the above problem, a multi-agent deep reinforcement learning based trajectory control algorithm is proposed for managing the trajectory of each UAV independently, where the popular Multi-Agent Deep Deterministic Policy Gradient (MADDPG) method is applied. Given the UAVs' trajectories, a low-complexity approach is introduced for optimizing the offloading decisions of UEs. We show that our proposed solution has considerable performance over other traditional algorithms, both in terms of the fairness for serving UEs, fairness of UE-load at each UAV and energy consumption for all the UEs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑