Far touch: integrating visual and haptic perceptual processing on wearables

Signal Processing;Perception;Wearables;Vision;Haptics;Touch;Image Processing;Foveation;Compression;Perceptually Lossless Compression;Lossy Compression;Electrotactile;Active Touch;Passive Touch;Visual-Haptic Environment;Haptic Environment;Sensitivity Index;Response Bias

Targino Da Costa, Andre Luiz Nunes

关键词: Signal Processing;    Perception;    Wearables;    Vision;    Haptics;    Touch;    Image Processing;    Foveation;    Compression;    Perceptually Lossless Compression;    Lossy Compression;    Electrotactile;    Active Touch;    Passive Touch;    Visual-Haptic Environment;    Haptic Environment;    Sensitivity Index;    Response Bias;   

Others  :  https://www.ideals.illinois.edu/bitstream/handle/2142/78418/TARGINODACOSTA-DISSERTATION-2015.pdf?sequence=1&isAllowed=y

美国|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

The evolution of electronic computers seems to have now reached the ubiquitous realm of wearable computing. Although a vast gamut of systems has been proposed so far, we believe most systems lack proper feedback for the user. In this dissertation, we not only contribute to solving the feedback problem, but we also consider the design of a system to acquire and reproduce the sense of touch. In order for such a system to be feasible, a few important problems need to be considered. Here, we address two of them. First, we know that wireless streaming of high resolution video to a head-mounted display requires high compression ratio. Second, we know that the choice of a proper feedback for the user depends on his/her ability to perceive it confidently across different scenarios.In order to solve the first problem, we propose a new limit that promises theoretically achievable data reduction ratios up to approximately 9:1 with no perceptual loss in typical scenarios. Also, we introduce a novel Gaussian foveation scheme that provides experimentally achievable gains up to approximately 2 times the compression ratio of typical compression schemes with less perceptual loss than in typical transmissions. The background material of both the limit and the foveation scheme includes a proposed pointwise retina-based constraint called pixel efficiency, that can be globally processed to reveal the perceptual efficiency of a display, and can be used together with a lossy parameter to locally control the spatial resolution of a foveated image.In order to solve the second problem, we provide an estimation of difference threshold that suggests that typically humans are able to discriminate between at least 6 different frequencies of an electrotactile stimulation. Also, we propose a novel sequence of experiments that suggests that a change from active touch to passive touch, or from a visual-haptic environment to a haptic environment, typically yields a reduction of the sensitivity index d' and in an increase of the response bias c.