Enhancing upper limb prosthetic embodiment through virtual reality with eye-tracking and vibrotactile feedback

Visconti, Alessandro; Lucaroni, Andrea; Calandra, Davide; Guarneri, Enea; Boccardo, Nicolo; Marinelli, Andrea; Laffranchi, Matteo; Barresi, Giacinto; Lamberti, Fabrizio

Abstract

The advances in bionic prosthetics yearly show impressive achievements in the effort to improve the motor capabilities and the quality of life of people facing the difficulties due to a limb amputation or agenesis. However, aligning the actual and the desired experience of using an artificial limb in daily activities constitutes an additional challenge. Indeed, several prosthetic users tend to abandon their bionic limbs because of (for instance) their lack of reliability and sensory feedback. Consequently, strategies for increasing the prosthetic technology acceptance are explored in literature, often referring to the phenomenon of the embodiment: the incorporation of an external object in the individual body scheme (the neurocognitive repre-sentation of one's body). Among the solutions for stimulating the prosthetic embodiment, the literature offers heterogeneous interactive trainings, often based on Virtual Reality (VR) settings. By exploiting the capability of digital environments to engage the user in repetitive exercises (as in the exergames) and to accurately elicit expected reactions (like the ones of the Rubber Hand Illusion, RHI), the study presented in this paper explores the use of immersive VR to enhance the sense of embodiment, focusing on one of its components, the body ownership - the sensation of owning the external object. The VR application developed for accomplishing this study includes a vibro-tactile feedback to increase the sensory engagement and facilitate the integration of a bionic upper limb - in this case the “Hannes” hand. In particular, the experiment compares two conditions: in one, the users (healthy subjects) use their gaze for attaching components of the digital limb after a certain dwell time, and evoking the vibro-tactile feedback; in the other condition, they must press a button with the other hand for completing the task without any dwell time. The two conditions are assessed using measures of body ownership, such as the proprioc...

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 2024 IEEE 3rd International Conference on Intelligent Reality (ICIR)
• Start Date: Dec 5, 2024
• End Date: Dec 6, 2024
• Acceptance Date: Oct 19, 2024
• Online Publication Date: May 1, 2025
• Publication Date: May 1, 2025
• Deposit Date: Jun 20, 2025
• Publicly Available Date: Jun 20, 2025
• Peer Reviewed: Peer Reviewed
• Pages: 1-8
• Book Title: 2024 IEEE 3rd International Conference on Intelligent Reality (ICIR)
• ISBN: 9798331534431
• DOI: https://doi.org/10.1109/icir64558.2024.10976964
• Public URL: https://uwe-repository.worktribe.com/output/14478685