arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.00091eess.SYcs.GTcs.MAcs.SY
收藏

面向飞行器的纳什软Actor-Critic低轨卫星切换管理算法

Nash Soft Actor-Critic LEO Satellite Handover Management Algorithm for Flying Vehicles

Jinxuan Chen, Mustafa Ozger, Cicek Cavdar

AI总结:

针对LEO卫星高速移动导致的频繁切换及多用户资源分配问题,提出结合多智能体强化学习与博弈论的Nash-SAC分布式切换策略,可显著降低切换次数与阻塞率、提升网络效用,保障各类用户可靠连接。

摘要:

与仅能支持有限覆盖区域的地面网络(TN)相比,低地球轨道(LEO)卫星可提供无缝全球覆盖,且在紧急情况下具备高生存能力。然而,LEO卫星的高速移动带来了挑战:频繁切换不可避免,会降低用户的服务质量(QoS)并导致连接中断。此外,考虑到不同飞行器(FV)与地面终端共存时的LEO卫星连接需求,需要高效的卫星切换决策控制和移动性管理策略,以减少切换次数并分配符合不同用户需求的资源。本文提出了一种基于多智能体强化学习(MARL)和博弈论的新型分布式卫星切换策略,名为Nash-SAC,用于解决上述问题。仿真结果表明,基于Nash-SAC的切换策略可有效减少超过16%的切换次数和超过18%的阻塞率,性能优于传统Q-learning等本地基准方法。该策略还将用于量化整个系统性能的网络效用大幅提升了高达48%,并能满足不同用户需求,为飞行器和地面终端提供可靠且鲁棒的连接。

英文摘要:

Compared with the terrestrial networks (TN), which can only support limited coverage areas, low-earth orbit (LEO) satellites can provide seamless global coverage and high survivability in case of emergencies. Nevertheless, the swift movement of the LEO satellites poses a challenge: frequent handovers are inevitable, compromising the quality of service (QoS) of users and leading to discontinuous connectivity. Moreover, considering LEO satellite connectivity for different flying vehicles (FVs) when coexisting with ground terminals, an efficient satellite handover decision control and mobility management strategy is required to reduce the number of handovers and allocate resources that align with different users' requirements. In this paper, a novel distributed satellite handover strategy based on Multi-Agent Reinforcement Learning (MARL) and game theory named Nash-SAC has been proposed to solve these problems. From the simulation results, the Nash-SAC-based handover strategy can effectively reduce the handovers by over 16 percent and the blocking rate by over 18 percent, outperforming local benchmarks such as traditional Q-learning. It also greatly improves the network utility used to quantify the performance of the whole system by up to 48 percent and caters to different users requirements, providing reliable and robust connectivity for both FVs and ground terminals.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑