An improved model for target detection and pose estimation of a teleoperation power manipulator

Frontiers in Neurorobotics

Neuroscience

Jianwen Guo¹  Li Xie¹  Yutian Li¹  Jiale Huang² 

[1] School of Mechanical Engineering, Dongguan University of Technology, Dongguan, China;School of Mechanical Engineering, Dongguan University of Technology, Dongguan, China;School of Electromechanical Engineering, Guangdong University of Technology, Guangzhou, China;

关键词: teleoperation power manipulator;    camera;    target detection;    pose estimation;    deep learning;   

DOI  :  10.3389/fnbot.2023.1193823

 received in 2023-03-25, accepted in 2023-07-17,  发布年份 2023

来源: Frontiers

【 摘 要 】

IntroductionA hot cell is generally deployed with a teleoperation power manipulator to complete tests, operations, and maintenance. The position and pose of the manipulator are mostly acquired through radiation-resistant video cameras arranged in the hot cell. In this paper, deep learning-based target detection technology is used to establish an experimental platform to test the methods for target detection and pose estimation of teleoperation power manipulators using two cameras.MethodsIn view of the fact that a complex environment affects the precision of manipulator pose estimation, the dilated-fully convolutional one-stage object detection (dilated-FCOS) teleoperation power manipulator target detection algorithm is proposed based on the scale of the teleoperation power manipulator. Model pruning is used to improve the real-time performance of the dilated-FCOS teleoperation power manipulator target detection model. To improve the detection speed for the key points of the teleoperation power manipulator, the keypoint detection precision and model inference speed of different lightweight backbone networks were tested based on the SimpleBaseline algorithm. MobileNetv1 was selected as the backbone network to perform channel compression and pose distillation on the upsampling module so as to further optimize the inference speed of the model.Results and discussionCompared with the original model, the proposed model was experimentally proven to reach basically the same precision within a shorter inference time (only 58% of that of the original model). The experimental results show that the compressed model basically retains the precision of the original model and that its inference time is 48% of that of the original model.

【 授权许可】

Unknown   
Copyright © 2023 Xie, Huang, Li and Guo.