Vision-based approach for autism diagnosis using transfer learning and eye-tracking

Elbattah, Mahmoud; Guérin, Jean-Luc; Carette, Romuald; Cilia, Federica; Dequen, Gilles

Abstract

The potentials of Transfer Learning (TL) have been well-researched in areas such as Computer Vision and Natural Language Processing. This study aims to explore a novel application of TL to detect Autism Spectrum Disorder. We seek to develop an approach that combines TL and eye-tracking, which is commonly used for analyzing autistic features. The key idea is to transform eye-tracking scanpaths into a visual representation, which could facilitate using pretrained vision models. Our experiments implemented a set of widely used models including VGG-16, ResNet, and DenseNet. Our results showed that the TL approach could realize a promising accuracy of classification (ROC-AUC up to 0.78). The proposed approach is not claimed to provide superior performance compared to earlier work. However, the study is primarily thought to convey an interesting aspect regarding the use of (synthetic) visual representations of eye-tracking output as a means to transfer representations from models pretrained on large-scale datasets such as ImageNet.

Citation

Elbattah, M., Guérin, J., Carette, R., Cilia, F., & Dequen, G. (2022). Vision-based approach for autism diagnosis using transfer learning and eye-tracking. In Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies - HEALTHINF (256-263). https://doi.org/10.5220/0010975500003123

• Conference Name: 15th International Conference on Health Informatics
• Conference Location: Online
• Start Date: Feb 9, 2022
• End Date: Feb 11, 2022
• Acceptance Date: Dec 21, 2021
• Publication Date: 2022
• Deposit Date: Apr 26, 2022
• Pages: 256-263
• Book Title: Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies - HEALTHINF
• ISBN: 9789897585524
• DOI: https://doi.org/10.5220/0010975500003123
• Public URL: https://uwe-repository.worktribe.com/output/9187298