Mahmoud Elbattah
Generative modeling of synthetic eye-tracking data: NLP-based approach with recurrent neural networks
Elbattah, Mahmoud; Guérin, Jean Luc; Carette, Romuald; Cilia, Federica; Dequen, Gilles
Authors
Jean Luc Guérin
Romuald Carette
Federica Cilia
Gilles Dequen
Abstract
This study explores a Machine Learning-based approach for generating synthetic eye-tracking data. In this respect, a novel application of Recurrent Neural Networks is experimented. Our approach is based on learning the sequence patterns of eye-tracking data. The key idea is to represent eye-tracking records as textual strings, which describe the sequences of fixations and saccades. The study therefore could borrow methods from the Natural Language Processing (NLP) domain for transforming the raw eye-tracking data. The NLP-based transformation is utilised to convert the high-dimensional eye-tracking data into an amenable representation for learning. Furthermore, the generative modeling could be implemented as a task of text generation. Our empirical experiments support further exploration and development of such NLP-driven approaches for the purpose of producing synthetic eye-tracking datasets for a variety of potential applications.
Presentation Conference Type | Conference Paper (Published) |
---|---|
Conference Name | International Joint Conference on Computational Intelligence |
Start Date | Nov 2, 2020 |
End Date | Nov 4, 2020 |
Acceptance Date | Aug 11, 2020 |
Publication Date | 2020 |
Deposit Date | Apr 26, 2022 |
Volume | 1 |
Pages | 479-484 |
Book Title | Proceedings of the 12th International Joint Conference on Computational Intelligence |
ISBN | 9789897584756 |
DOI | https://doi.org/10.5220/0010177204790484 |
Public URL | https://uwe-repository.worktribe.com/output/9206322 |
You might also like
NLP-based prediction of medical specialties at hospital admission using triage notes
(2021)
Presentation / Conference Contribution
The role of text analytics in healthcare: A review of recent developments and applications
(2021)
Presentation / Conference Contribution
Deep learning to predict hospitalization at triage: Integration of structured data and unstructured text
(2020)
Presentation / Conference Contribution
NLP-based approach to detect autism spectrum disorder in saccadic eye movement
(2020)
Presentation / Conference Contribution
Heatmaps for visual explainability of CNN-based predictions for multivariate time series with application to healthcare
(2020)
Presentation / Conference Contribution
Downloadable Citations
About UWE Bristol Research Repository
Administrator e-mail: repository@uwe.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search