Robo-HUD: Interaction Concept for Contactless Operation of Industrial Cobotic Systems

Applied Sciences

Jan Hintz¹  Ayoub Al-Hamadi¹  Dominykas Strazdas¹ 

[1] Neuro-Information Technology, Otto-von-Guericke-University Magdeburg, 39106 Magdeburg, Germany;

关键词: augmented reality;    activity recognition;    cooperative systems;    gesture recognition;    human–robot interaction;    intelligent robots;   

DOI  :  10.3390/app11125366

来源: DOAJ

【 摘 要 】

Intuitive and safe interfaces for robots are challenging issues in robotics. Robo-HUD is a gadget-less interaction concept for contactless operation of industrial systems. We use virtual collision detection based on time-of-flight sensor data, combined with augmented reality and audio feedback, allowing the operators to navigate a virtual menu by “hover and hold” gestures. When incorporated with virtual safety barriers, the collision detection also functions as a safety feature, slowing or stopping the robot if a barrier is breached. Additionally, a user focus recognition module monitors the awareness, enabling the interaction only when intended. Early case studies show that these features present good use-cases for inspection tasks and operation in difficult environments, where contactless operation is needed.

【 授权许可】

Unknown