Inertial Sensor-Based Touch and Shake Metaphor for Expressive Control of 3D Virtual Avatars

Sensors

Shashidhar Patil²  Harinadha Reddy Chintalapalli²  Dubeom Kim²  Youngho Chai¹ 

[1] Graduate School of Advanced Imaging Science, Multimedia and Film Chung-Ang University, Seoul 156-756, Korea;

关键词: inertial sensors;    gestural interfaces;    expressive control;    gesture recognition;    gesture variations;    interactive systems;    touch and shake;    virtual avatar;   

DOI  :  10.3390/s150614435

来源: mdpi

【 摘 要 】

In this paper, we present an inertial sensor-based touch and shake metaphor for expressive control of a 3D virtual avatar in a virtual environment. An intuitive six degrees-of-freedom wireless inertial motion sensor is used as a gesture and motion control input device with a sensor fusion algorithm. The algorithm enables user hand motions to be tracked in 3D space via magnetic, angular rate, and gravity sensors. A quaternion-based complementary filter is implemented to reduce noise and drift. An algorithm based on dynamic time-warping is developed for efficient recognition of dynamic hand gestures with real-time automatic hand gesture segmentation. Our approach enables the recognition of gestures and estimates gesture variations for continuous interaction. We demonstrate the gesture expressivity using an interactive flexible gesture mapping interface for authoring and controlling a 3D virtual avatar and its motion by tracking user dynamic hand gestures. This synthesizes stylistic variations in a 3D virtual avatar, producing motions that are not present in the motion database using hand gesture sequences from a single inertial motion sensor.

【 授权许可】

CC BY   
© 2015 by the authors; licensee MDPI, Basel, Switzerland.