Supplementary Reinforcement Learning Controller Designed for Quadrotor UAVs

IEEE Access

Xiaobo Lin¹  Yao Yu¹  Changyin Sun² 

[1] School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China;School of Automation, Southeast University, Nanjing, China;

关键词: Quadrotor;    UAVs;    reinforcement learning;    ADP;    control system;   

DOI  :  10.1109/ACCESS.2019.2901295

来源: DOAJ

【 摘 要 】

The control problem for quadrotor UAVs is difficult and challenging due to the complex nonlinear dynamics and ever-changing disturbances. In this paper, a supplementary controller based on reinforcement learning (RL) is proposed to improve the control performance of quadrotor UAVs. The proposed RL method is constructed by an actor-critic structure and some improved technologies, e.g., Q-learning, temporal difference, and experience replay. With the proposed method, the speed and stability of training can be improved greatly. On one hand, the supplementary controller can work together with the traditional controller online, which can guarantee the stability of the system. On the other hand, the model uncertainties and external disturbances could be restrained through online RL training. The Lyapunov theory is used to prove the convergence of the RL controller's weights theoretically. Finally, three simulations are provided to illustrate the effectiveness of the proposed controller.

【 授权许可】

Unknown