arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.07240eess.SYcs.LGcs.ROcs.SY
收藏

自主水面车辆无碰撞跟踪控制的模型参考强化学习

Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles

Delft University of Technology(代尔夫特理工大学)

Qingrui Zhang, Wei Pan, Vasso Reppa

摘要:

提出了一种新的模型参考强化学习算法,用于不确定自主水面车辆的智能避碰跟踪控制。该控制算法结合了传统的控制方法与强化学习,以提高控制精度和智能。在所提出的控制设计中,标称系统被认为是使用传统的控制方法的基线跟踪控制器的设计。标称系统还定义了在无障碍环境中的不确定自主表面车辆的期望行为。得益于强化学习,整体跟踪控制器能够补偿模型不确定性,并在有障碍物的环境中同时实现碰撞避免。与传统的深度强化学习方法相比,我们提出的基于学习的控制可以提供稳定性保证和更好的样本效率。我们展示了新算法的性能,使用自主表面车辆的例子。

英文摘要:

This paper presents a novel model-reference reinforcement learning algorithm for the intelligent tracking control of uncertain autonomous surface vehicles with collision avoidance. The proposed control algorithm combines a conventional control method with reinforcement learning to enhance control accuracy and intelligence. In the proposed control design, a nominal system is considered for the design of a baseline tracking controller using a conventional control approach. The nominal system also defines the desired behaviour of uncertain autonomous surface vehicles in an obstacle-free environment. Thanks to reinforcement learning, the overall tracking controller is capable of compensating for model uncertainties and achieving collision avoidance at the same time in environments with obstacles. In comparison to traditional deep reinforcement learning methods, our proposed learning-based control can provide stability guarantees and better sample efficiency. We demonstrate the performance of the new algorithm using an example of autonomous surface vehicles.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑