Toward local and global perception modules for vision substitution

NEUROCOMPUTING

卷:74

Article; Proceedings Paper

Bologna, Guido¹  Deville, Benoit¹  Gomez, Juan Diego¹  Pun, Thierry¹ 

[1] Univ Geneva, Dept Comp Sci, CH-1227 Carouge, Switzerland

关键词: Sensorial substitution;    Colour sonification;    Mobility experiments;    Stereo-vision;    Sound spatialisation;   

DOI  :  10.1016/j.neucom.2010.07.022

来源: Elsevier

【 摘 要 】

Although retinal neural implants have considerably progressed they raise a number of questions concerning user acceptance, risk rejection, and cost. For the time being we support a low cost approach based on the transmission of limited vision information by means of the auditory channel. The See ColOr mobility aid for visually impaired individuals transforms a small portion of a coloured video image into sound sources represented by spatialised musical instruments. Basically, the conversion of colours into sounds is achieved by quantisation of the HSL colour system. Our purpose is to provide blind people with a capability of perception of the environment in real time. In this work the novelty is the simultaneous sonification of colour and depth, the last parameter being coded by sound rhythm. The main drawback of our approach is that the sonification of a limited portion of a captured image involves limited perception. As a consequence, we propose to extend the local perception module by introducing a new global perception module aiming at providing the user with a clear picture of the entire scene characteristics. Finally, we present several experiments to illustrate the limited perception module, such as: (1) detecting an open door in order to go out from the office; (2) walking in a hallway and looking for a blue cabinet; (3) walking in a hallway and looking for a red tee shirt: (4) avoiding two red obstacles; (5) moving outside and avoiding a parked car. Videos of experiments are available on http://www.youtube.com/guidobologna. (C) 2010 Elsevier B.V. All rights reserved.

【 授权许可】

Free