Open-source re-configurable interfacing of Tobii Pro Glasses 2 with ROS2

Nunez Sardinha, Emanuel; Ruiz Garate, Virginia

Abstract

Gaze tracking is a powerful assistive tool enabling people with severe disabilities to interact with complex systems intuitively. Among these, screen-based gaze-control is one of the main input tools used with people with severe mobility impairments, with the eye-tracking being performed by a camera embedded on the screen (video-oculography). Complete User Interface (U.I.) systems have been built based on this direct interaction, mimicking a point and click system to select actions, point at keywords, or spell words (e.g, theGrid products). This provides an intuitive an easy-to-learn interface for most users with screen-based gaze-control systems being widely adopted by people with mobility impairments. Moreover, several studies successfully used them as control for complex setups, such as robotic arms mounted on wheelchairs and interacting with home appliances from a wheelchair.

• Presentation Conference Type: Conference Paper (unpublished)
• Conference Name: XR & Robotics Workshop at IROS 2022
• Start Date: Oct 23, 2022
• End Date: Oct 27, 2022
• Deposit Date: Oct 18, 2022
• Keywords: Extended Reality, ROS2, Robotics, Gaze-control, Performance
• Public URL: https://uwe-repository.worktribe.com/output/9987592
• Related Public URLs: https://iros2022.org/; ; https://www.youtube.com/watch?v=uywrVT-dUdg