Dynamic Positioning using Deep Reinforcement Learning

OCEAN ENGINEERING

卷:235

Article

Overeng, Simen Sem¹  Nguyen, Dong Trong^1,2  Hamre, Geir² 

[1] NTNU, Dept Marine Technol, N-7491 Trondheim, Norway

[2] DNV, Veritasveien 1, N-1363 Hovik, Norway

关键词: Dynamic Positioning;    Deep Reinforcement Learning;    Proximal policy optimization;    Reward shaping;   

DOI  :  10.1016/j.oceaneng.2021.109433

来源: Elsevier

【 摘 要 】

This paper demonstrates the implementation and performance testing of a Deep Reinforcement Learning based control scheme used for Dynamic Positioning of a marine surface vessel. The control scheme encapsulated motion control and control allocation by using a neural network, which was trained on a digital twin without having any prior knowledge of the system dynamics, using the Proximal Policy Optimization learning algorithm. By using a multivariate Gaussian reward function for rewarding small errors between the vessel and the various setpoints, while encouraging small actuator outputs, the proposed Deep Reinforcement Learning based control scheme showed good positioning performance while being energy efficient. Both simulations and model scale sea trials were carried out to demonstrate performance compared to traditional methods, and to evaluate the ability of neural networks trained in simulation to perform on real life systems.

【 授权许可】

Free