Vessel navigation is difficult in restricted waterways and in the presence of static and dynamic obstacles. This difficulty can be attributed to the high-level decisions taken by humans during these maneuvers, which is evident from the fact that 85% of the reported marine accidents are traced back to human errors. Artificial intelligence-based methods offer us a way to eliminate human intervention in vessel navigation. Newer methods like Deep Reinforcement Learning (DRL) can optimize multiple objectives like path following and collision avoidance at the same time while being computationally cheaper to implement in comparison to traditional approaches. Before addressing the challenge of collision avoidance along with path following, the performance of DRL-based controllers on the path following task alone must be established. Therefore, this study trains a DRL agent using Proximal Policy Optimization (PPO) algorithm and tests it against a traditional PD controller guided by an Integral Line of Sight (ILOS) guidance system. The Krisco Container Ship (KCS) is chosen to test the different controllers. The ship dynamics are mathematically simulated using the Maneuvering Modelling Group (MMG) model developed by the Japanese. The simulation environment is used to train the deep reinforcement learning-based controller and is also used to tune the gains of the traditional PD controller. The effectiveness of the controllers in the presence of wind is also investigated.
Optimal Universal Controllers for Roll Stabilization
Oceaneering AGV Systems B.V.(Oceaneering AGV系统有限公司);University of Groningen(格罗宁根大学);Politecnico di Torino(都灵理工大学);Institute for Problems of Mechanical Engineering(机械工程学院问题研究所)
Stranding Risk for Underactuated Vessels in Complex Ocean Currents: Analysis and Controllers
Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA(加州大学伯克利分校电气工程与计算机科学系);School of Computation, Information and Technology of the Technical(技术学院计算、信息与技术学院)