arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.13207cs.NIcs.AI
收藏

面向可靠无线自主性的安全约束强化学习框架

A Safety-Constrained Reinforcement Learning Framework for Reliable Wireless Autonomy

Faculty of Engineering and Technology(工程与技术学院);Sunway University(Sunway大学);Future Cities Research Institute(未来城市研究 institutes)

Abdikarim Mohamed Ibrahim, Rosdiadee Nordin

AI总结:

本文提出一种主动安全约束强化学习框架,通过整合证明携带控制与赋能预算,以确保无线自主性中的安全性和可靠性。

摘要:

人工智能(AI)和强化学习(RL)在无线系统中展现出显著的潜力,能够实现动态频谱分配、交通管理以及大规模物联网(IoT)协调。然而,其在关键任务应用中的部署引入了不安全的涌现行为的风险,例如无人机碰撞、拒绝服务事件或车联网的不稳定。现有安全机制大多为反应型,依赖于异常检测或回退控制器,在不安全行为发生后才介入,这无法保证在超可靠低时延通信(URLLC)环境下的可靠性。在本工作中,我们提出了一种主动的安全约束RL框架,该框架整合了证明携带控制(PCC)与赋能预算(EB)执行。每个智能体的动作通过轻量级的数学证书进行验证,以确保符合干扰约束,同时赋能预算调节安全覆盖的频率,以平衡安全与自主性。我们使用近端策略优化(PPO)在无线上行调度任务中实现了该框架。仿真结果表明,所提出的PCC+EB控制器消除了不安全的传输,同时保持系统吞吐量和可预测的自主性。与无约束和反应型基线相比,我们的方法实现了可证明的安全保证,且性能损失最小。这些结果突显了主动安全约束RL在未来的6G网络中实现可信无线自主性的潜力。

英文摘要:

Artificial intelligence (AI) and reinforcement learning (RL) have shown significant promise in wireless systems, enabling dynamic spectrum allocation, traffic management, and large-scale Internet of Things (IoT) coordination. However, their deployment in mission-critical applications introduces the risk of unsafe emergent behaviors, such as UAV collisions, denial-of-service events, or instability in vehicular networks. Existing safety mechanisms are predominantly reactive, relying on anomaly detection or fallback controllers that intervene only after unsafe actions occur, which cannot guarantee reliability in ultra-reliable low-latency communication (URLLC) settings. In this work, we propose a proactive safety-constrained RL framework that integrates proof-carrying control (PCC) with empowerment-budgeted (EB) enforcement. Each agent action is verified through lightweight mathematical certificates to ensure compliance with interference constraints, while empowerment budgets regulate the frequency of safety overrides to balance safety and autonomy. We implement this framework on a wireless uplink scheduling task using Proximal Policy Optimization (PPO). Simulation results demonstrate that the proposed PCC+EB controller eliminates unsafe transmissions while preserving system throughput and predictable autonomy. Compared with unconstrained and reactive baselines, our method achieves provable safety guarantees with minimal performance degradation. These results highlight the potential of proactive safety constrained RL to enable trustworthy wireless autonomy in future 6G networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑