Virtual reality approach to enhancing hazard perception in construction using eye-tracking and deep learning

Mahamadu, Abdul-Majeed; Prabhakaran, Abhinesh; Manu, Patrick; Xiang, Yiming; Booth, Colin A.

Abstract

Over 50% of onsite hazards remain unrecognized, primarily due to poor hazard perception and attention deficits. Eye-tracking can help in understanding human visual attention and cognitive response, but its application in construction has been restricted by the reliance on two-dimensional (2D) stimulus, such as pictures, which often lack realism. This study proposes a novel Immersive Virtual Reality (VR) system integrated with computer vision (eye-tracking) technology for visual attention measurement. The study further explores the characterisation of VR eye-tracking data using Deep Learning Techniques. Based on tests with (n=15) construction professionals across four experiments, VR eye-tracking was found to be a viable platform for understanding visual behaviour in hazard perception tasks. A Long Short-Term Memory (LSTM) deep learning model was further applied to the eye-tracking data and was found to effectively predict data peculiarities, as well as hazard identification performance of participants. The study provides preliminary evidence of the usefulness of eye-tracking data in VR simulations for enhancing safety training and provides pathways for real-time visual attention data measurement for safety interventions on construction sites.

• Online Publication Date: Jun 27, 2025
• Publication Date: Jun 27, 2025
• Deposit Date: Jun 8, 2025
• Book Title: Applications of Immersive Technology in Architecture, Engineering and Construction A Handbook
• Chapter Number: 6
• ISBN: 9781032657066
• Public URL: https://uwe-repository.worktribe.com/output/14549102
• Publisher URL: https://www.taylorfrancis.com/chapters/edit/10.1201/9781032662909-8/virtual-reality-approach-enhancing-hazard-perception-construction-using-eye-tracking-deep-learning-abdul-majeed-mahamadu-abhinesh-prabhakaran-patrick-manu-yiming-xiang-colin-booth
• Contract Date: Feb 11, 2025