arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.04401eess.SPcs.LG
收藏

一种启发式集成深度强化学习方法用于大规模可重构智能表面相位优化

A Heuristic-Integrated DRL Approach for Phase Optimization in Large-Scale RISs

Communication Systems and Networks Research Group, University of Bristol(布里斯托大学通信系统与网络研究组);Bristol Research & Innovation Laboratory, Toshiba Europe Ltd.(布里斯托研究与创新实验室,东芝欧洲有限公司)

Wei Wang, Peizheng Li, Angela Doufexi, Mark A. Beach

AI总结:

本文提出启发式集成DRL框架,结合DDQN多步累积动作与贪心算法逐元素优化,在小动作空间内实现大规模RIS离散相移的高效优化。

摘要:

在大规模可重构智能表面(RIS)中优化离散相移因其非凸和非线性特性而具有挑战性。本文提出一种启发式集成的深度强化学习(DRL)框架,该框架(1)在双深度Q网络(DDQN)中利用多步累积动作进行RIS按列控制,(2)将贪心算法(GA)集成到每个DRL步骤中,通过细粒度的逐元素优化RIS配置来改进状态。通过从包含GA的状态中学习,所提方法在较小的DRL动作空间内有效解决了RIS优化问题,展示了其优化大规模RIS相移配置的能力。

英文摘要:

Optimizing discrete phase shifts in large-scale reconfigurable intelligent surfaces (RISs) is challenging due to their non-convex and non-linear nature. In this letter, we propose a heuristic-integrated deep reinforcement learning (DRL) framework that (1) leverages accumulated actions over multiple steps in the double deep Q-network (DDQN) for RIS column-wise control and (2) integrates a greedy algorithm (GA) into each DRL step to refine the state via fine-grained, element-wise optimization of RIS configurations. By learning from GA-included states, the proposed approach effectively addresses RIS optimization within a small DRL action space, demonstrating its capability to optimize phase-shift configurations of large-scale RISs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑