Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind

Sensors

Donghun Kim¹  Kwangtaek Kim² 

[1] School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA; E-Mail:;Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-IT Technology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea

关键词: finger pointing gestures;    3D pointing direction estimation;    obstacle detection;    stereo camera system;    human computer interaction;    tactile feedback;    virtual cane;   

DOI  :  10.3390/s140610412

来源: mdpi

【 摘 要 】

In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user's pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.

【 授权许可】

CC BY   
© 2014 by the authors; licensee MDPI, Basel, Switzerland.