突破CSI瓶颈:基于MARL的反射阵列空间控制
Bypassing the CSI Bottleneck: MARL-Driven Spatial Control for Reflector Arrays
AI总结:
本文提出基于MARL的反射阵列空间控制方法,通过映射高维机械约束到虚拟焦点空间,实现无CSI操作,提升空间选择性和时间稳定性。
摘要:
可重构智能表面(RIS)对下一代智能无线电环境至关重要,但其实际部署受到信道状态信息(CSI)估计计算开销的严重限制。为突破这一物理层障碍,本文提出一种AI原生、数据驱动的范式,用空间智能替代复杂信道建模。本文提出一个完全自主的多智能体强化学习(MARL)框架来控制可调机械反射阵列。通过将高维机械约束映射到降阶虚拟焦点空间,我们部署了集中训练与分散执行(CTDE)架构。使用多智能体近端策略优化(MAPPO),我们的分散智能体学习依赖用户坐标的协作波束聚焦策略,实现无CSI操作。高保真射线追踪仿真在动态非视线(NLOS)环境中表明,这种多智能体方法能快速适应用户移动,相较于静态平面反射器提升高达26.86 dB,并在空间选择性和时间稳定性上优于单智能体和硬件受限DRL基线。关键的是,学习到的策略表现出良好的部署鲁棒性,在1.0米定位噪声下仍能维持稳定的信号覆盖。这些结果验证了MARL驱动的空间抽象作为AI赋能无线网络的可扩展且高度实用的路径的有效性。
英文摘要:
Reconfigurable Intelligent Surfaces (RIS) are pivotal for next-generation smart radio environments, yet their practical deployment is severely bottlenecked by the intractable computational overhead of Channel State Information (CSI) estimation. To bypass this fundamental physical-layer barrier, we propose an AI-native, data-driven paradigm that replaces complex channel modeling with spatial intelligence. This paper presents a fully autonomous Multi-Agent Reinforcement Learning (MARL) framework to control mechanically adjustable metallic reflector arrays. By mapping high-dimensional mechanical constraints to a reduced-order virtual focal point space, we deploy a Centralized Training with Decentralized Execution (CTDE) architecture. Using Multi-Agent Proximal Policy Optimization (MAPPO), our decentralized agents learn cooperative beam-focusing strategies relying on user coordinates, achieving CSI-free operation. High-fidelity ray-tracing simulations in dynamic non-line-of-sight (NLOS) environments demonstrate that this multi-agent approach rapidly adapts to user mobility, yielding up to a 26.86 dB enhancement over static flat reflectors and outperforming single-agent and hardware-constrained DRL baselines in both spatial selectivity and temporal stability. Crucially, the learned policies exhibit good deployment resilience, sustaining stable signal coverage even under 1.0-meter localization noise. These results validate the efficacy of MARL-driven spatial abstractions as a scalable, highly practical pathway toward AI-empowered wireless networks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。