Joe Simmons
The ballad of the bots: Sonification using cognitive metaphor to support immersed teleoperation of robot teams
Simmons, Joe; Bremner, Paul; Mitchell, Thomas J; Bown, Alison; McIntosh, Verity
Authors
Paul Bremner Paul2.Bremner@uwe.ac.uk
Associate Professor in Human Robotics Interactions
Tom Mitchell Tom.Mitchell@uwe.ac.uk
Professor of Audio and Music Interaction
Alison Bown
Verity McIntosh Verity.Mcintosh@uwe.ac.uk
Associate Professor of Virtual and Extended Realities
Abstract
As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are used to characterise a chamber within a virtual nuclear facility. This study examines the potential utility and impact of sonification as a means of communicating salient operator data in such an environment. However, the question of what sound should be used and how it can be applied in different applications is far from resolved. This paper explores and compares two sonification design approaches. The first is inspired by the theory of cognitive metaphor to create sonifications that align with socially acquired contextual and ecological understanding of the application domain. The second adopts a computationalist approach using auditory mappings that are commonplace in the literature. The results suggest that the computationalist approach outperforms the cognitive metaphor approach in terms of predictability and mental workload. However, qualitative data analysis demonstrates that the cognitive metaphor approach resulted in sounds that were more intuitive, and were better implemented for spatialisation of data sources and data legibility when there was more than one sound source.
Journal Article Type | Article |
---|---|
Acceptance Date | Jun 4, 2024 |
Online Publication Date | Jun 20, 2024 |
Publication Date | Jun 20, 2024 |
Deposit Date | Jul 22, 2024 |
Publicly Available Date | Jan 2, 2025 |
Journal | Frontiers in Virtual Reality |
Print ISSN | 2673-4192 |
Electronic ISSN | 2673-4192 |
Publisher | Frontiers Media |
Peer Reviewed | Peer Reviewed |
Volume | 5 |
Article Number | 1404865 |
DOI | https://doi.org/10.3389/frvir.2024.1404865 |
Keywords | robotics, teleoperation, sonification, virtual reality, nuclear decommissioning |
Public URL | https://uwe-repository.worktribe.com/output/12701611 |
Files
The ballad of the bots: Sonification using cognitive metaphor to support immersed teleoperation of robot teams
(1.3 Mb)
PDF
Licence
http://creativecommons.org/licenses/by/4.0/
Publisher Licence URL
http://creativecommons.org/licenses/by/4.0/
You might also like
Hear here: Sonification as a design strategy for robot teleoperation using virtual reality
(2023)
Presentation / Conference Contribution
Lessons learned: Symbiotic autonomous robot ecosystem for nuclear environments
(2023)
Journal Article
Downloadable Citations
About UWE Bristol Research Repository
Administrator e-mail: repository@uwe.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2025
Advanced Search