Recent advancements in multimodal human–robot interaction

Frontiers in Neurorobotics

Neuroscience

Chenguang Yang¹  Hang Su²  Med Amine Laribi³  Juan Sandoval³  Wen Qi⁴  Jiahao Chen⁵ 

[1] Bristol Robotics Laboratory, University of the West of England, Bristol, United Kingdom;Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy;Department of GMSC, Pprime Institute, CNRS, ENSMA, University of Poitiers, Poitiers, France;School of Future Technology, South China University of Technology, Guangzhou, China;State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China;

关键词: multi-modal signal processing;    multi-modal feedback;    multi-modal human–robot interaction;    physical human–robot interaction;    human–robot interaction;   

DOI  :  10.3389/fnbot.2023.1084000

 received in 2022-10-29, accepted in 2023-04-20,  发布年份 2023

来源: Frontiers

【 摘 要 】

Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript.

【 授权许可】

Unknown   
Copyright © 2023 Su, Qi, Chen, Yang, Sandoval and Laribi.