Usability study of a novel triple-arm mixed-reality robot teleoperation system

Sobhani, Mehdi; Smith, Alex; Giuliani, Manuel; Pipe, Tony

Abstract

The usability of a novel triple-arm mixed-reality robot teleoperation system is investigated. The system is developed to provide a sense of remote presence for the operator. Different types of interfaces and camera setups have been proposed previously. Our novel approach is to have a moving stereo vision camera mounted on a robotic arm in the remote scene controlled with a virtual reality (VR) headset. By streaming live stereo video into the VR headset in a video see-through configuration the operator experiences a sense of remote presence. The teleoperation task is done using two more robotic arms. These arms are set up in a mirror teleoperation setting so that the remote (follower) arm copies the movements of the control (leader) arm. To investigate the effect of latency on the operator a within-subject usability study of the system with 20 participants has been conducted. Participants completed a pick-and-place task sorting objects into marked containers in two conditions. In one condition, the camera robot arm was controlled by a joint position controller with low latency but jittery robot motion. In the other condition, the camera robot was controlled by a joint velocity controller with higher latency but smooth motion. Participants completed the System Usability Scale questionnaire after each trial. The task completion time and participants' head movement were also recorded as objective measures. The study result did not show a significant difference in any of the objective or subjective measures, although, the position controller scored higher overall. This could be due to the number of participants or the ability of people to adapt to the latency in the system and further analysis in future work is required.

Citation

Sobhani, M., Smith, A., Giuliani, M., & Pipe, T. (2023). Usability study of a novel triple-arm mixed-reality robot teleoperation system. In IEEE 2022 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR) (217-223). https://doi.org/10.1109/ssrr56537.2022.10018630

• Conference Name: IEEE 2022 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)
• Conference Location: Sevilla, Spain
• Start Date: Nov 8, 2022
• End Date: Nov 10, 2022
• Acceptance Date: Sep 15, 2022
• Online Publication Date: Jan 24, 2023
• Publication Date: Jan 24, 2023
• Deposit Date: Feb 14, 2023
• Publicly Available Date: Jan 25, 2025
• Publisher: Institute of Electrical and Electronics Engineers (IEEE)
• Pages: 217-223
• Series ISSN: 2475-8426; 2374-3247
• Book Title: IEEE 2022 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR)
• ISBN: 9781665456814
• DOI: https://doi.org/10.1109/ssrr56537.2022.10018630
• Keywords: Teleoperation, Mixed-Reality, Human-Robot Interaction, Remote presence, System Usability; Headphones, Atmospheric measurements, Robot vision systems, Virtual reality, Streaming media, Cameras, Manipulator
• Public URL: https://uwe-repository.worktribe.com/output/10425450
• Publisher URL: https://ieeexplore.ieee.org/document/10018630/
• Related Public URLs: https://ieeexplore.ieee.org/xpl/conhome/10018603/proceeding