Adding Pluggable and Personalized Natural Control Capabilities to Existing Applications

Sensors

Fabrizio Lamberti¹  Andrea Sanna²  Gilles Carlevaris² 

[1] Dipartimento di Automatica e Informatica, Politecnico di Torino, Corso Duca degli Abruzzi 24, 10129 Torino, Italy;

关键词: natural user interfaces;    poses;    gestures and voice;    human-computer interaction;   

DOI  :  10.3390/s150202832

来源: mdpi

【 摘 要 】

Advancements in input device and sensor technologies led to the evolution of the traditional human-machine interaction paradigm based on the mouse and keyboard. Touch-, gesture- and voice-based interfaces are integrated today in a variety of applications running on consumer devices (e.g., gaming consoles and smartphones). However, to allow existing applications running on desktop computers to utilize natural interaction, significant re-design and re-coding efforts may be required. In this paper, a framework designed to transparently add multi-modal interaction capabilities to applications to which users are accustomed is presented. Experimental observations confirmed the effectiveness of the proposed framework and led to a classification of those applications that could benefit more from the availability of natural interaction modalities.

【 授权许可】

CC BY   
© 2015 by the authors; licensee MDPI, Basel, Switzerland.