arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1804.04154cs.RO
收藏

UAV姿态控制的强化学习方法

Reinforcement Learning for UAV Attitude Control

Boston University(波士顿大学)

William Koch, Renato Mancuso, Richard West, Azer Bestavros

摘要:

自动驾驶系统通常由提供稳定性和控制的“内环”组成,而“外环”负责任务级目标,例如航路点导航。无人机的自动驾驶仪系统主要使用比例积分微分(PID)控制系统来实现,其在稳定环境中表现出优异的性能。然而,需要更复杂的控制来在不可预测和恶劣的环境中运行。智能飞行控制系统是一个活跃的研究领域,最近通过使用强化学习(RL)解决PID控制的局限性,RL在其他应用中取得了成功,如机器人。然而,以前的工作主要集中在任务级控制器上使用RL。在这项工作中,我们调查的性能和精度的内部控制回路提供姿态控制时,使用智能飞行控制系统的训练与国家的最先进的RL算法,深度确定性梯度政策(DDGP),信任域策略优化(TRPO)和近端策略优化(PPO)。为了研究这些未知因素,我们首先开发了一个开源的高保真仿真环境,通过RL训练飞行控制器对四旋翼飞机的姿态控制。然后,我们使用我们的环境来比较它们的性能的PID控制器,以确定是否使用RL是适当的高精度,时间关键的飞行控制。

英文摘要:

Autopilot systems are typically composed of an "inner loop" providing stability and control, while an "outer loop" is responsible for mission-level objectives, e.g. way-point navigation. Autopilot systems for UAVs are predominately implemented using Proportional, Integral Derivative (PID) control systems, which have demonstrated exceptional performance in stable environments. However more sophisticated control is required to operate in unpredictable, and harsh environments. Intelligent flight control systems is an active area of research addressing limitations of PID control most recently through the use of reinforcement learning (RL) which has had success in other applications such as robotics. However previous work has focused primarily on using RL at the mission-level controller. In this work, we investigate the performance and accuracy of the inner control loop providing attitude control when using intelligent flight control systems trained with the state-of-the-art RL algorithms, Deep Deterministic Gradient Policy (DDGP), Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO). To investigate these unknowns we first developed an open-source high-fidelity simulation environment to train a flight controller attitude control of a quadrotor through RL. We then use our environment to compare their performance to that of a PID controller to identify if using RL is appropriate in high-precision, time-critical flight control.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑