Corrective Filter Based on Kinematics of Human Hand for Pose Estimation

Frontiers in Virtual Reality

Joseph H. R. Isaac¹  Balaraman Ravindran²  M. Manivannan³ 

[1] Department of Computer Science and Engineering Indian Institute of Technology Madras, Chennai, India;Robert Bosch Center for Data Science and Artificial Intelligence (RBC-DSAI) and Department of Computer Science and Engineering, Indian Institute of Technology Madras, Chennai, India;Touch Lab, Department of Applied Mechanics Indian Institute of Technology Madras, Chennai, India;

关键词: 3D hand tracking;    biomechanics;    kinematics;    articulated body;    computer vision;    virtual reality;   

DOI  :  10.3389/frvir.2021.663618

来源: DOAJ

【 摘 要 】

Depth-based 3D hand trackers are expected to estimate highly accurate poses of the human hand given the image. One of the critical problems in tracking the hand pose is the generation of realistic predictions. This paper proposes a novel “anatomical filter” that accepts a hand pose from a hand tracker and generates the closest possible pose within the real human hand’s anatomical bounds. The filter works by calculating the 26-DoF vector representing the joint angles and correcting those angles based on the real human hand’s biomechanical limitations. The proposed filter can be plugged into any hand tracker to enhance its performance. The filter has been tested on two state-of-the-art 3D hand trackers. The empirical observations show that our proposed filter improves the hand pose’s anatomical correctness and allows a smooth trade-off with pose error. The filter achieves the lowest prediction error when used with state-of-the-art trackers at 10% correction.

【 授权许可】

Unknown