Skip to main content

Research Repository

Advanced Search

Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction

Giuliani, Manuel; Knoll, Alois

Authors

Manuel Giuliani Manuel.Giuliani@uwe.ac.uk
Co- Director Bristol Robotics Laboratory

Alois Knoll



Abstract

We present a robot that is working with humans on a common construction task. In this kind of interaction, it is important that the robot can perform different roles in order to realise an efficient collaboration. For this, we introduce embodied multimodal fusion, a new approach for processing data from the robot's input modalities. Using this method, we implemented two different robot roles: the robot can take the instructive role, in which the robot mainly instructs the user how to proceed with the construction; or the robot can take the supportive role, in which the robot hands over assembly pieces to the human that fit to the current progress of the assembly plan. We present a user evaluation that researches how humans react to the different roles of the robot. The main findings of this evaluation are that the users do not prefer one of the two roles of the robot, but take the counterpart to the robot's role and adjust their own behaviour according to the robot's actions. The most influential factors for user satisfaction in this kind of interaction are the number of times the users picked up a building piece without getting an explicit instruction by the robot, which had a positive influence, and the number of utterances the users made themselves, which had a negative influence. © 2013 Springer Science+Business Media Dordrecht.

Journal Article Type Article
Acceptance Date May 2, 2013
Online Publication Date Jun 5, 2013
Publication Date Aug 1, 2013
Journal International Journal of Social Robotics
Print ISSN 1875-4791
Electronic ISSN 1875-4805
Publisher Springer Verlag
Peer Reviewed Peer Reviewed
Volume 5
Issue 3
Pages 345-356
DOI https://doi.org/10.1007/s12369-013-0194-y
Keywords human-robot interaction, embodied multimodal fusion, robot roles
Public URL https://uwe-repository.worktribe.com/output/929366
Publisher URL http://dx.doi.org/10.1007/s12369-013-0194-y
Related Public URLs http://link.springer.com/article/10.1007%2Fs12369-013-0194-y