Paul Bremner Paul2.Bremner@uwe.ac.uk
Associate Professor in Human Robotics Interactions
Iconic gestures for robot avatars, recognition and integration with speech
Bremner, Paul; Leonards, Ute
Authors
Ute Leonards
Abstract
© 2016 Bremner and Leonards. Co-verbal gestures are an important part of human communication, improving its efficiency and efficacy for information conveyance. One possible means by which such multi-modal communication might be realized remotely is through the use of a tele-operated humanoid robot avatar. Such avatars have been previously shown to enhance social presence and operator salience. We present a motion tracking based tele-operation system for the NAO robot platform that allows direct transmission of speech and gestures produced by the operator. To assess the capabilities of this system for transmitting multi-modal communication, we have conducted a user study that investigated if robot-produced iconic gestures are comprehensible, and are integrated with speech. Robot performed gesture outcomes were compared directly to those for gestures produced by a human actor, using a within participant experimental design. We show that iconic gestures produced by a tele-operated robot are understood by participants when presented alone, almost as well as when produced by a human. More importantly, we show that gestures are integrated with speech when presented as part of a multi-modal communication equally well for human and robot performances.
Citation
Bremner, P., & Leonards, U. (2016). Iconic gestures for robot avatars, recognition and integration with speech. Frontiers in Psychology, 7, https://doi.org/10.3389/fpsyg.2016.00183
Journal Article Type | Article |
---|---|
Acceptance Date | Jan 31, 2016 |
Publication Date | Feb 17, 2016 |
Deposit Date | Mar 31, 2016 |
Publicly Available Date | Mar 31, 2016 |
Journal | Frontiers in Psychology |
Electronic ISSN | 1664-1078 |
Publisher | Frontiers Media |
Peer Reviewed | Peer Reviewed |
Volume | 7 |
DOI | https://doi.org/10.3389/fpsyg.2016.00183 |
Keywords | human-robot interaction, multi-modal communication |
Public URL | https://uwe-repository.worktribe.com/output/917236 |
Publisher URL | http://dx.doi.org/10.3389/fpsyg.2016.00183 |
Additional Information | Additional Information : This Document is Protected by copyright and was first published by Frontiers. All rights reserved. it is reproduced with permission. |
Files
fpsyg-07-00183.pdf
(2.3 Mb)
PDF
You might also like
Lessons learned: Symbiotic autonomous robot ecosystem for nuclear environments
(2023)
Journal Article
Usability of an immersive control system for a humanoid robot surrogate
(2022)
Conference Proceeding
User requirements for a robot teleoperation system for general medical examination
(2022)
Conference Proceeding
The impact of data sonification in virtual reality robot teleoperation
(2022)
Journal Article
Downloadable Citations
About UWE Bristol Research Repository
Administrator e-mail: repository@uwe.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search