arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09157eess.SP
收藏

基于基础模型的分层深度强化学习用于RIS辅助网络中阻塞感知的链路

Foundation Model-Aided Hierarchical Deep Reinforcement Learning for Blockage-Aware Link in RIS-Assisted Networks

School of Electrical Engineering and Computer Science, University of Ottawa(渥太华大学电气与计算机工程学院);Ericsson Inc.(爱立信公司)

Mohammad Ghassemi, Han Zhang, Ali Afana, Akram Bin Sediq, Melike Erol-Kantarci

AI总结:

本文提出基于基础模型的分层深度强化学习框架,用于RIS辅助网络中提升频谱效率的阻塞感知链路优化。

摘要:

可重构智能表面(RIS)技术有潜力显著提高6G无线网络的频谱效率(SE)。然而,实际部署仍受动态条件下准确信道估计和控制优化的挑战。本文提出了一种基于基础模型的分层深度强化学习(FM-HDRL)框架,用于RIS辅助无线网络中的联合波束成形和相移优化。为此,我们首先对预训练的大型无线模型(LWM)进行微调,将原始信道数据转换为低维、上下文感知的信道状态信息(CSI)嵌入。接下来,这些嵌入与用户位置信息和阻塞状态结合,以选择最优的通信路径。所得特征随后输入到假设在集中控制器中实现的HDRL模型,以联合优化基站(BS)波束成形向量和RIS相移配置,以最大化SE。仿真结果表明,所提出的FM-HDRL框架在收敛速度、频谱效率和可扩展性方面均优于基线方法。根据仿真结果,所提出的方法相比FM辅助深度强化学习(FM-DRL)方法提高了7.82%的SE,相比波束扫描方法提高了约48.66%。

英文摘要:

Reconfigurable intelligent surface (RIS) technology has the potential to significantly enhance the spectral efficiency (SE) of 6G wireless networks. However, practical deployment remains constrained by challenges in accurate channel estimation and control optimization under dynamic conditions. This paper presents a foundation model-aided hierarchical deep reinforcement learning (FM-HDRL) framework designed for joint beamforming and phase-shift optimization in RIS-assisted wireless networks. To implement this, we first fine-tune a pre-trained large wireless model (LWM) to translate raw channel data into low-dimensional, context-aware channel state information (CSI) embeddings. Next, these embeddings are combined with user location information and blockage status to select the optimal communication path. The resulting features are then fed into an HDRL model, assumed to be implemented at a centralized controller, which jointly optimizes the base station (BS) beamforming vectors and the RIS phase-shift configurations to maximize SE. Simulation results demonstrate that the proposed FM-HDRL framework consistently outperforms baseline methods in terms of convergence speed, spectral efficiency, and scalability. According to the simulation results, our proposed method improves 7.82% SE compared to the FM-aided deep reinforcement learning (FM-DRL) approach and a substantial enhancement of about 48.66% relative to the beam sweeping approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑