arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.07584cs.NI
收藏

PHaul:一种用于Sub6增强型综合接入与回传网络的基于近端策略优化(PPO)的转发代理

PHaul: A PPO-based forwarding agent for Sub6 enhanced Integrated Access and Backhaul networks

I2CAT Foundation(I2CAT基金会)

Jorge Pueyo, Daniel Camps-Mur and, Miguel Catalan-Cid

AI总结:

研究Sub6增强型IAB网络的转发问题,提出PHaul,结合离线启发式算法与基于PPO的在线DRL代理,利用网络数字孪生采样更新映射,相比替代算法,能提升吞吐量效率和公平性,且对拓扑差异有鲁棒性。

摘要:

3GPP综合接入与回传(IAB)网络使运营商能通过复用接入和回传频谱来经济高效地部署室外毫米波接入网络。IAB网络的性能瓶颈在于无线回传部分,需要高效转发策略。毫米波IAB回传性能还依赖视距(LoS)条件。本文提出用额外的Sub6回传链路补充IAB网络的毫米波回传部分,形成Sub6增强型IAB网络。主要贡献是PHaul,它是适用于Sub6增强型IAB网络的转发引擎,结合离线路径选择启发式算法和基于近端策略优化(PPO)的在线深度强化学习(DRL)代理。利用IAB无线回传的网络数字孪生,PHaul定期采样回传网络输入流量并更新流到路径的映射,在实际回传拓扑中执行时间低于10秒。通过详尽性能评估表明,与两种替代启发式算法相比,PHaul在多种网络配置下吞吐量效率可提高36%,公平性提高20%,且对训练和推理阶段网络拓扑差异具有鲁棒性。

英文摘要:

3GPP Integrated Access and Backhaul (IAB) allows operators to deploy outdoor mm-wave access networks in a cost-efficient manner, by reusing the same spectrum in access and backhaul. In IAB networks the performance bottleneck is the wireless backhaul segment, where efficient forwarding strategies are needed to effectively use the available capacity. In addition, the performance of the mm-wave IAB backhaul segment is contingent on the availability of line of sight (LoS) conditions in the selected deployment sites. To mitigate LoS dependence, in this paper, we propose to complement the mm-wave backhaul segment of IAB networks with additional Sub6 backhaul links, which contribute to the capacity and robustness of the backhaul network. We refer to IAB networks combining Sub6 and mm-wave links in the backhaul as Sub6 enhanced IAB networks. In this context, the main contribution of this paper is PHaul, a forwarding engine for Sub6 enhanced IAB networks that accomodates different traffic engineering criteria, and combines an offline path selection heuristic with an online Deep Reinforcement Learning (DRL) agent based on Proximal Policy Optimization (PPO). By leveraging a network digital twin of the IAB wireless backhaul, PHaul periodically samples the input traffic of the backhaul network and updates flow to path mappings, with execution times below 10 seconds in realistic backhaul topologies. We present an exhaustive performance evaluation, where we demonstrate that PHaul can achieve gains of up to 36\% in throughput efficiency and of up to 20\% in fairness, when compared against two alternative heuristics in a wide range of network configurations. We also demonstrate that PHaul is robust to differences between the network topologies considered in the training and inference phases, which can occur in practice due to link failures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑