Generative modeling of synthetic eye-tracking data: NLP-based approach with recurrent neural networks

Elbattah, Mahmoud; Guérin, Jean Luc; Carette, Romuald; Cilia, Federica; Dequen, Gilles

Abstract

This study explores a Machine Learning-based approach for generating synthetic eye-tracking data. In this respect, a novel application of Recurrent Neural Networks is experimented. Our approach is based on learning the sequence patterns of eye-tracking data. The key idea is to represent eye-tracking records as textual strings, which describe the sequences of fixations and saccades. The study therefore could borrow methods from the Natural Language Processing (NLP) domain for transforming the raw eye-tracking data. The NLP-based transformation is utilised to convert the high-dimensional eye-tracking data into an amenable representation for learning. Furthermore, the generative modeling could be implemented as a task of text generation. Our empirical experiments support further exploration and development of such NLP-driven approaches for the purpose of producing synthetic eye-tracking datasets for a variety of potential applications.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: International Joint Conference on Computational Intelligence
• Start Date: Nov 2, 2020
• End Date: Nov 4, 2020
• Acceptance Date: Aug 11, 2020
• Publication Date: 2020
• Deposit Date: Apr 26, 2022
• Volume: 1
• Pages: 479-484
• Book Title: Proceedings of the 12th International Joint Conference on Computational Intelligence
• ISBN: 9789897584756
• DOI: https://doi.org/10.5220/0010177204790484
• Public URL: https://uwe-repository.worktribe.com/output/9206322