A Disturbance Rejection Control Method Based on Deep Reinforcement Learning for a Biped Robot

Applied Sciences

Dingkui Tian¹  Chuzhao Liu¹  Huaxin Liu¹  Libo Meng¹  Junyao Gao¹  Xuefeng Zhang² 

[1] Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, 5 Nandajie, Zhongguancun, Haidian, Beijing 100081, China;School of Mechanical Engineering, Yanshan University, 438 Hebeidajie, Haigang, Qinhuangdao 066000, China;

关键词: biped robot;    model zero-moment-point control;    deep reinforcement learning;   

DOI  :  10.3390/app11041587

来源: DOAJ

【 摘 要 】

The disturbance rejection performance of a biped robot when walking has long been a focus of roboticists in their attempts to improve robots. There are many traditional stabilizing control methods, such as modifying foot placements and the target zero moment point (ZMP), e.g., in model ZMP control. The disturbance rejection control method in the forward direction of the biped robot is an important technology, whether it comes from the inertia generated by walking or from external forces. The first step in solving the instability of the humanoid robot is to add the ability to dynamically adjust posture when the robot is standing still. The control method based on the model ZMP control is among the main methods of disturbance rejection for biped robots. We use the state-of-the-art deep-reinforcement-learning algorithm combined with model ZMP control in simulating the balance experiment of the cart–table model and the disturbance rejection experiment of the ASIMO humanoid robot standing still. Results show that our proposed method effectively reduces the probability of falling when the biped robot is subjected to an external force in the x-direction.

【 授权许可】

Unknown