Iconic gestures for robot avatars, recognition and integration with speech

Bremner, Paul; Leonards, Ute

doi:10.3389/fpsyg.2016.00183

Iconic gestures for robot avatars, recognition and integration with speech

Bremner, Paul; Leonards, Ute

Authors

Paul Bremner Paul2.Bremner@uwe.ac.uk
Associate Professor in Human Robotics Interactions

Ute Leonards

Abstract

© 2016 Bremner and Leonards. Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances.

Journal Article Type	Article
Acceptance Date	Jan 31, 2016
Publication Date	Feb 17, 2016
Deposit Date	Mar 31, 2016
Publicly Available Date	Mar 31, 2016
Journal	Frontiers in Psychology
Electronic ISSN	1664-1078
Publisher	Frontiers Media
Peer Reviewed	Peer Reviewed
Volume	7
DOI	https://doi.org/10.3389/fpsyg.2016.00183
Keywords	human-robot interaction, multi-modal communication
Public URL	https://uwe-repository.worktribe.com/output/917236
Publisher URL	http://dx.doi.org/10.3389/fpsyg.2016.00183
Additional Information	Additional Information : This Document is Protected by copyright and was first published by Frontiers. All rights reserved. it is reproduced with permission.
Contract Date	Mar 31, 2016