arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.09013cs.ROcs.LG
收藏

基于深度Q网络强化学习的电厂无人机自检方法

Self-Inspection Method of Unmanned Aerial Vehicles in Power Plants Using Deep Q-Network Reinforcement Learning

University of Toronto(多伦多大学)

Haoran Guan

摘要:

为了检查发电厂,可以使用强化学习技术来构建自主机器人。该方法复制的环境,并采用一个简单的强化学习(RL)算法。这一战略可适用于若干部门,包括发电部门。研究提出了一个具有感知、计划和行动的预训练模型。为了解决优化问题,例如无人机(UAV)导航问题,DeepMind于2015年推出的基于强化学习的框架Deep Q-network(DQN)结合了深度学习和Q-learning。为了克服现有流程中存在的问题,本研究提出了一种结合无人机自主导航和DQN强化学习的电厂巡检系统。这些训练过程参考状态设置奖励函数,并考虑内部和外部影响因素,这将它们与现在使用的其他强化学习训练技术区分开来。例如,该技术的强化学习部分的关键组成部分引入了风场模拟、无人机的电池充电水平、无人机达到的高度等状态。经过训练的模型使无人机能够在困难的环境中自行移动,从而更有可能将检查策略应用于实践。该模型的平均得分收敛到9000。经过训练的模型允许无人机进行到达目标点所需的最少旋转次数。

英文摘要:

For the purpose of inspecting power plants, autonomous robots can be built using reinforcement learning techniques. The method replicates the environment and employs a simple reinforcement learning (RL) algorithm. This strategy might be applied in several sectors, including the electricity generation sector. A pre-trained model with perception, planning, and action is suggested by the research. To address optimization problems, such as the Unmanned Aerial Vehicle (UAV) navigation problem, Deep Q-network (DQN), a reinforcement learning-based framework that Deepmind launched in 2015, incorporates both deep learning and Q-learning. To overcome problems with current procedures, the research proposes a power plant inspection system incorporating UAV autonomous navigation and DQN reinforcement learning. These training processes set reward functions with reference to states and consider both internal and external effect factors, which distinguishes them from other reinforcement learning training techniques now in use. The key components of the reinforcement learning segment of the technique, for instance, introduce states such as the simulation of a wind field, the battery charge level of an unmanned aerial vehicle, the height the UAV reached, etc. The trained model makes it more likely that the inspection strategy will be applied in practice by enabling the UAV to move around on its own in difficult environments. The average score of the model converges to 9,000. The trained model allowed the UAV to make the fewest number of rotations necessary to go to the target point.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑