RadDQN:一种基于深度Q学习的架构,用于寻找时间高效且辐射暴露最小的路径
RadDQN: a Deep Q Learning-based Architecture for Finding Time-efficient Minimum Radiation Exposure Pathway
AI总结:
RadDQN是一种基于深度Q学习的架构,通过辐射感知奖励函数和优化探索策略,提升无人机在辐射区域中的路径规划效率和辐射防护能力。
摘要:
最近深度强化学习(DRL)技术的进步激发了其在自动化领域的多样化应用。利用DRL处理复杂决策问题,鼓励其在核工业中用于优化正常运行条件和潜在事故场景中人员的辐射暴露。然而,缺乏高效的奖励函数和有效的探索策略阻碍了其在开发辐射感知的自主无人机(UAV)中的应用,以实现最大辐射防护。本文中,我们解决了这些有趣的问题,介绍了一种基于深度Q学习的架构(RadDQN),该架构基于辐射感知的奖励函数,在辐射区域中提供时间高效且辐射暴露最小的路径。我们提出了一组独特的探索策略,根据训练过程中状态层面的辐射暴露变化来微调探索和利用的程度。此外,我们通过基于网格的确定性方法对预测路径进行基准测试。我们证明了所设计的奖励函数与充分的探索策略相结合,能够有效处理具有剧烈不同辐射场分布的多个场景。与原始DQN相比,我们的模型在收敛速度和训练稳定性方面表现更优。
英文摘要:
Recent advancements in deep reinforcement learning (DRL) techniques have sparked its multifaceted applications in the automation sector. Managing complex decision-making problems with DRL encourages its use in the nuclear industry for tasks such as optimizing radiation exposure to the personnel during normal operating conditions and potential accidental scenarios. However, the lack of efficient reward function and effective exploration strategy thwarted its implementation in the development of radiation-aware autonomous unmanned aerial vehicle (UAV) for achieving maximum radiation protection. Here, in this article, we address these intriguing issues and introduce a deep Q-learning based architecture (RadDQN) that operates on a radiation-aware reward function to provide time-efficient minimum radiation-exposure pathway in a radiation zone. We propose a set of unique exploration strategies that fine-tune the extent of exploration and exploitation based on the state-wise variation in radiation exposure during training. Further, we benchmark the predicted path with grid-based deterministic method. We demonstrate that the formulated reward function in conjugation with adequate exploration strategy is effective in handling several scenarios with drastically different radiation field distributions. When compared to vanilla DQN, our model achieves a superior convergence rate and higher training stability.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。