发表机构
School of Information Science and Engineering, Shenyang University of Technology; School of Mechanical Engineering, Shenyang University of Technology（沈阳工业大学信息科学与工程学院; 沈阳工业大学机械工程学院）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
提出QP-BD3QN-RACH，一种基于配额投影分支深度强化学习的RACH前导码切片控制器，用于混合2RA/4RA随机接入，在多种负载下优于四种比较方法。
AI 中文摘要
服务质量（QoS）感知的随机接入需要对有限的随机接入信道（RACH）前导码预算在异构流量和接入过程之间进行自适应分配。本文提出QP-BD3QN-RACH，一种用于混合两步（2RA）和四步（4RA）基于竞争的随机接入的配额投影分支深度强化学习控制器。四个动作分支分别对应延迟敏感和延迟容忍的2RA/4RA前导码池。分支决斗双DQN选择各池特定的乘数，确定性配额投影将其转换为保持前导码预算的非负整数分配。每个分支有五个动作，控制器使用20个分支动作输出表示625个投影前的分支动作元组。评估涵盖五种到达负载、标称种子42下的跨方法比较、QP-BD3QN-RACH的六种子敏感性以及针对性消融实验。在五种负载网格上，其相对于四个比较器的平均方向对齐差异均为正：成功/碰撞为5.74至8.21个百分点，回退为1.23至1.92个百分点，阻塞为0.35至0.68个百分点，成功接入延迟为0.128至0.456个决策间隔。逐负载结果表现出依赖于指标的权衡，尤其是在中等和过载条件下。
英文摘要
Quality-of-service (QoS)-aware random access requires adaptive allocation of a finite random access channel (RACH) preamble budget across heterogeneous traffic and access procedures. This paper proposes QP-BD3QN-RACH, a quota-projected branching deep reinforcement learning controller for mixed two-step (2RA) and four-step (4RA) contention-based random access. Four action branches correspond to the delay-sensitive and delay-tolerant 2RA/4RA preamble pools. A branching dueling Double DQN selects pool-specific multipliers, and deterministic quota projection converts them to nonnegative integer allocations that preserve the preamble budget. With five actions per branch, the controller represents 625 pre-projection branch-action tuples using 20 branch-action outputs. Evaluation covers five arrival loads, cross-method comparison under nominal seed 42, six-seed sensitivity of QP-BD3QN-RACH, and targeted ablations. Across the five-load grid, its mean direction-aligned differences relative to four comparators are positive: 5.74 to 8.21 percentage points for success/collision, 1.23 to 1.92 percentage points for fallback, 0.35 to 0.68 percentage points for blocking, and 0.128 to 0.456 decision intervals for successful-access delay. Load-wise results exhibit metric-dependent tradeoffs, particularly under intermediate and overload conditions.
Comments12 pages, 10 figures
