面向毫米波模型中干扰源识别与波束功率控制的数字孪生参考信念引导Q学习
Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model
AI总结:
该研究提出数字孪生参考模型与信念引导Q学习算法,用于毫米波网络的干扰源识别与波束功率控制,经仿真验证其在链路速率、功率效率及检测准确率上优于对比算法,为6G安全波束控制提供概念验证。
摘要:
数字孪生(Digital Twin, DT)与强化学习(Reinforcement Learning, RL)结合,可通过对比预期与观测到的网络行为,支持自适应资源分配和安全感知决策。本文针对特定场景下的28GHz网络,提出一种基于仿真的DT参考模型和信念引导Q学习(Belief-Guided Q-Learning, BGQL)算法,用于联合干扰源识别与波束功率控制。对于每个动作,在无攻击和受攻击两种配置下对同一信道模拟器进行评估,将接收机级残差与空间干扰足迹结合并累加,形成归一化的怀疑向量。BGQL将该向量整合到聚合状态、信念集中奖励函数以及探索性波束选择规则中。在匹配的攻击者集合下,将BGQL与SARSA、Greedy、Random算法进行对比实验:在四种配置下开展30次配对蒙特卡洛运行,为每种方法提供活跃干扰源数量,BGQL的平均聚合全波段链路速率得分约为437.4--564.2 Mbit/s,设备功率比速率得分约为60.37--76.79 Mbit/J;在单干扰源配置下其检测准确率为100%,双干扰源配置下约为78%--81%;BGQL每次运行耗时约80--130秒,而SARSA仅需5--14秒,这是因为BGQL在探索步骤中需评估625个波束对。这些发现为6G网络中安全感知波束功率控制的DT参考信念引导学习提供了匹配模型的仿真概念验证。
英文摘要:
Next-generation wireless networks are expected to support high data rates and reliable connectivity while meeting requirements for energy efficiency, resource management, and communication security. Digital Twin (DT) technology represents expected network behavior and enables the actual network state to be assessed against it. Integrating DT technology with reinforcement learning (RL) supports adaptive resource allocation and security-aware decision-making. This paper presents a simulation-based DT reference and a belief-guided Q-learning (BGQL) method for joint jammer identification and beam-power control in a site-specific 28-GHz network model. Receiver-level residuals between attack-free and attacked configurations are combined with candidate spatial jamming footprints and accumulated into a normalized suspicion vector. BGQL incorporates this vector into its state, reward, and exploratory beam-selection rule. Compared with SARSA, Greedy, and Random across 30 paired Monte Carlo runs per configuration, with known jammer counts, BGQL achieves link-rate scores of 437.4-564.2 Mbit/s, rate-to-device-power scores of 60.37-76.79 Mbit/J, and localization recall of 100% for one jammer and 78%-81% for two jammers. BGQL requires 80-130 s per run versus 5-14 s for SARSA. These findings provide a matched-model simulation proof of concept for DT-referenced belief-guided learning for security-aware beam-power control in 6G networks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。