低空卫星-无人机协同联合移动边缘计算与数据采集 via 基于扩散的深度强化学习
Low-Altitude Satellite-AAV Collaborative Joint Mobile Edge Computing and Data Collection via Diffusion-based Deep Reinforcement Learning
AI总结:
本文提出基于扩散的深度强化学习方法,用于低空卫星-无人机协同联合移动边缘计算与数据采集,以提高效率和性能。
摘要:
卫星与自主空中车辆(AAV)通信的整合已成为需要广泛覆盖和快速部署的场景的关键,特别是在偏远或灾害地区,其中地面基础设施不可用。此外,新兴应用越来越多地要求在同一空中网络中同时具备移动边缘计算(MEC)和数据采集(DC)能力。然而,在异构的卫星-AAV系统中联合优化这些操作存在重大挑战,因为受限的机载资源和动态信道条件下竞争的需求。在本工作中,我们研究了一种卫星-AAV启用的联合MEC-DC系统,其中这些平台协作服务地面设备(GDs)。具体而言,我们提出了一个联合优化问题,以最小化平均MEC端到端延迟和AAV能耗,同时最大化收集的数据。由于所提出的优化问题是一个非凸混合整数非线性规划(MINLP)问题,我们提出了一种基于Q加权变分策略优化的联合AAV运动控制、GD关联、卸载决策和带宽分配(QAGOB)方法。具体来说,我们将优化问题重新表述为一个动作空间转换的马尔可夫决策过程,以适应变量动作维度和混合动作空间。随后,QAGOB利用扩散模型的多模式生成能力来优化策略,并在训练过程中能够更高效地利用样本同时控制扩散成本。仿真结果表明,QAGOB在五个其他基准上表现更优,包括传统DRL和基于扩散的DRL算法。此外,MEC-DC联合优化在与MEC和DC分别优化相比时具有显著优势。
英文摘要:
The integration of satellite and autonomous aerial vehicle (AAV) communications has become essential for the scenarios requiring both wide coverage and rapid deployment, particularly in remote or disaster-stricken areas where the terrestrial infrastructure is unavailable. Furthermore, emerging applications increasingly demand simultaneous mobile edge computing (MEC) and data collection (DC) capabilities within the same aerial network. However, jointly optimizing these operations in heterogeneous satellite-AAV systems presents significant challenges due to limited on-board resources and competing demands under dynamic channel conditions. In this work, we investigate a satellite-AAV-enabled joint MEC-DC system where these platforms collaborate to serve ground devices (GDs). Specifically, we formulate a joint optimization problem to minimize the average MEC end-to-end delay and AAV energy consumption while maximizing the collected data. Since the formulated optimization problem is a non-convex mixed-integer nonlinear programming (MINLP) problem, we propose a Q-weighted variational policy optimization-based joint AAV movement control, GD association, offloading decision, and bandwidth allocation (QAGOB) approach. Specifically, we reformulate the optimization problem as an action space-transformed Markov decision process to adapt the variable action dimensions and hybrid action space. Subsequently, QAGOB leverages the multi-modal generation capacities of diffusion models to optimize policies and can achieve better sample efficiency while controlling the diffusion costs during training. Simulation results show that QAGOB outperforms five other benchmarks, including traditional DRL and diffusion-based DRL algorithms. Furthermore, the MEC-DC joint optimization achieves significant advantages when compared to the separate optimization of MEC and DC.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。