Dexterous object manipulation by a multi-fingered robotic hand with visual-tactile fingertip sensors

ROBOMECH Journal

article

Seung-hyun Choi¹  Kenji Tahara² 

[1] Department of Mechanical Engineering, Graduate School of Engineering, Kyushu University;Department of Mechanical Engineering, Faculty of Engineering, Kyushu University

关键词: Visual-tactile sensor;    Multi-fingered hand;    Grasping;    Manipulation;   

DOI  :  10.1186/s40648-020-00162-5

学科分类：社会科学、人文和艺术（综合）

来源: Springer

【 摘 要 】

In this paper, a novel visual-tactile sensor is proposed; additionally, an object manipulation method for a multi-fingered robotic hand grasping an object is proposed by detecting a contact position using the visual-tactile sensor. The visual-tactile sensor is composed of a hemispheric fingertip made of soft silicone with a hollow interior and a general USB camera located inside the fingertip to detect the displacement of the many point markers embedded in the silicone. The deformation of each point marker due to a contact force is measured, and a contact position is estimated reliably through a novel method of creating virtual points to determine the point clouds. The aim is to demonstrate both the estimation performance of the new visual-tactile sensor and its usefulness in a grasping and manipulation task. By using the contact position obtained from the proposed sensor and the position of each fingertip obtained from kinematics, the position and orientation of a grasped object are estimated and controlled. The effectiveness of the method is illustrated through numerical simulation and its practical use is demonstrated through grasping and manipulating experiments.

【 授权许可】

CC BY