arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.03391cs.LGcs.AI
收藏

面向分层MEC使能的空地网络中队列感知任务卸载的多智能体DRL

Multi-Agent DRL for Queue-Aware Task Offloading in Hierarchical MEC-Enabled Air-Ground Networks

Hamad Bin Khalifa University(哈马德·本·哈利法大学);College of Science and Engineering(科学与工程学院);Division of Information and Computing Technology(信息与计算技术系);College of Engineering, Qatar University(卡塔尔大学工程学院)

Muhammet Hevesli, Abegaz Mohammed Seid, Aiman Erbad, Mohamed Abdallah

AI总结:

本文针对MEC使能的空地网络,提出基于Beta分布的多智能体近端策略优化算法(MAPPO-BD),通过联合优化UAV轨迹、资源分配与任务卸载,实现了高效节能与资源管理。

摘要:

移动边缘计算(MEC)使能的空地网络是6G的关键组成部分,采用诸如无人机(UAV)和高空平台站(HAPS)的空中基站(ABS),为地面物联网设备(IoTDs)提供动态服务。这些IoTDs支持实时应用(例如多媒体和元宇宙服务),这些应用在延迟和任务队列管理方面需要高计算资源和严格的服务质量(QoS)保证。鉴于其有限的能量和处理能力,IoTDs依靠UAV和HAPS卸载任务以进行分布式处理,从而形成多层MEC系统。本文通过联合优化UAV轨迹、计算资源分配和队列感知任务卸载决策,解决MEC使能的空地综合网络(MAGIN)中的总能量最小化问题。由于该分层系统的非凸、非线性特性,传统方法无效,使得优化具有挑战性。我们将该问题重新表述为具有连续动作空间和异构智能体的多智能体马尔可夫决策过程(MDP),并提出一种基于Beta分布的多智能体近端策略优化变体(MAPPO-BD)来解决它。大量仿真表明,MAPPO-BD优于基线方案,在满足队列延迟和边缘计算约束的同时,在MAGIN中实现了卓越的节能和高效的资源管理。

英文摘要:

Mobile edge computing (MEC)-enabled air-ground networks are a key component of 6G, employing aerial base stations (ABSs) such as unmanned aerial vehicles (UAVs) and high-altitude platform stations (HAPS) to provide dynamic services to ground IoT devices (IoTDs). These IoTDs support real-time applications (e.g., multimedia and Metaverse services) that demand high computational resources and strict quality of service (QoS) guarantees in terms of latency and task queue management. Given their limited energy and processing capabilities, IoTDs rely on UAVs and HAPS to offload tasks for distributed processing, forming a multi-tier MEC system. This paper tackles the overall energy minimization problem in MEC-enabled air-ground integrated networks (MAGIN) by jointly optimizing UAV trajectories, computing resource allocation, and queue-aware task offloading decisions. The optimization is challenging due to the nonconvex, nonlinear nature of this hierarchical system, which renders traditional methods ineffective. We reformulate the problem as a multi-agent Markov decision process (MDP) with continuous action spaces and heterogeneous agents, and propose a novel variant of multi-agent proximal policy optimization with a Beta distribution (MAPPO-BD) to solve it. Extensive simulations show that MAPPO-BD outperforms baseline schemes, achieving superior energy savings and efficient resource management in MAGIN while meeting queue delay and edge computing constraints.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑