arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.04074cs.NIcs.LG
收藏

面向低空经济的集成感知与通信:一种深度强化学习方法

Integrated Sensing and Communications for Low-Altitude Economy: A Deep Reinforcement Learning Approach

City University of Hong Kong(香港城市大学);The Hong Kong Polytechnic University(香港理工大学);Shanghai Jiao Tong University(上海交通大学);Xiamen University(厦门大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Future Network of Intelligence Institute(深圳未来智能网络研究院);Guangdong Provincial Key Laboratory of Future Networks of Intelligence(广东省未来智能网络重点实验室)

Xiaowen Ye, Yuyi Mao, Xianghao Yu, Shu Sun, Liqun Fu, Jie Xu

AI总结:

本文针对低空经济场景提出基于深度强化学习的集成感知与通信方案DeepLSC,通过联合优化波束成形与无人机轨迹,在满足感知和飞行约束下提升通信和速率、收敛速度与鲁棒性。

摘要:

本文研究了一种用于低空经济(LAE)的集成感知与通信(ISAC)系统,其中地面基站(GBS)为已授权的无人机(UAV)提供通信和导航服务,同时对低空空域进行感知以监测未授权的移动目标。通过联合优化GBS处的波束成形和无人机轨迹,在给定飞行周期内最大化期望通信和速率,同时满足感知的平均信噪比要求、无人机飞行任务与避碰约束以及GBS的最大发射功率约束。通常,这是一个具有给定飞行任务的序贯决策问题。因此,我们将其转化为一种特定的马尔可夫决策过程(MDP)模型,称为回合式任务。基于该建模,我们利用深度强化学习(DRL)技术,提出了一种新颖的面向LAE的ISAC方案,称为Deep LAE-ISAC(DeepLSC)。在DeepLSC中,精心设计了奖励函数和一种新的动作选择策略,称为约束噪声探索策略,以满足各种约束条件。为了实现回合式任务中的高效学习,我们开发了一种分层经验回放机制,其要点是利用每个回合内产生的所有经验来联合训练神经网络。此外,为了提高DeepLSC的收敛速度,提出了一种对称经验增强机制,该机制同时置换所有变量的索引以丰富可用经验集。仿真结果表明,与基准方案相比,DeepLSC在满足预设约束的同时获得了更高的和速率,实现了更快的收敛,并且对不同设置具有更强的鲁棒性。

英文摘要:

This paper studies an integrated sensing and communications (ISAC) system for low-altitude economy (LAE), where a ground base station (GBS) provides communication and navigation services for authorized unmanned aerial vehicles (UAVs), while sensing the low-altitude airspace to monitor the unauthorized mobile target. The expected communication sum-rate over a given flight period is maximized by jointly optimizing the beamforming at the GBS and UAVs' trajectories, subject to the constraints on the average signal-to-noise ratio requirement for sensing, the flight mission and collision avoidance of UAVs, as well as the maximum transmit power at the GBS. Typically, this is a sequential decision-making problem with the given flight mission. Thus, we transform it to a specific Markov decision process (MDP) model called episode task. Based on this modeling, we propose a novel LAE-oriented ISAC scheme, referred to as Deep LAE-ISAC (DeepLSC), by leveraging the deep reinforcement learning (DRL) technique. In DeepLSC, a reward function and a new action selection policy termed constrained noise-exploration policy are judiciously designed to fulfill various constraints. To enable efficient learning in episode tasks, we develop a hierarchical experience replay mechanism, where the gist is to employ all experiences generated within each episode to jointly train the neural network. Besides, to enhance the convergence speed of DeepLSC, a symmetric experience augmentation mechanism, which simultaneously permutes the indexes of all variables to enrich available experience sets, is proposed. Simulation results demonstrate that compared with benchmarks, DeepLSC yields a higher sum-rate while meeting the preset constraints, achieves faster convergence, and is more robust against different settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑