Skip to main content

Research Repository

Advanced Search

Recent advancements in multimodal human–robot interaction

Su, Hang; Qi, Wen; Chen, Jiahao; Yang, Chenguang; Sandoval, Juan; Laribi, Med Amine

Recent advancements in multimodal human–robot interaction Thumbnail


Hang Su

Wen Qi

Jiahao Chen

Juan Sandoval

Med Amine Laribi


Robotics have advanced significantly over the years, and human–robot interaction (HRI) is now playing an important role in delivering the best user experience, cutting down on laborious tasks, and raising public acceptance of robots. New HRI approaches are necessary to promote the evolution of robots, with a more natural and flexible interaction manner clearly the most crucial. As a newly emerging approach to HRI, multimodal HRI is a method for individuals to communicate with a robot using various modalities, including voice, image, text, eye movement, and touch, as well as bio-signals like EEG and ECG. It is a broad field closely related to cognitive science, ergonomics, multimedia technology, and virtual reality, with numerous applications springing up each year. However, little research has been done to summarize the current development and future trend of HRI. To this end, this paper systematically reviews the state of the art of multimodal HRI on its applications by summing up the latest research articles relevant to this field. Moreover, the research development in terms of the input signal and the output signal is also covered in this manuscript.

Journal Article Type Review
Acceptance Date Apr 20, 2023
Online Publication Date May 11, 2023
Publication Date May 11, 2023
Deposit Date Jun 6, 2023
Publicly Available Date Jun 6, 2023
Journal Frontiers in Neurorobotics
Electronic ISSN 1662-5218
Publisher Frontiers Media
Peer Reviewed Peer Reviewed
Volume 17
Article Number 1084000
Keywords multi-modal human–robot interaction, multi-modal feedback, human–robot interaction, physical human–robot interaction, multi-modal signal processing
Public URL
Publisher URL


You might also like

Downloadable Citations