From Real-time Attention Assessment to “With-me-ness” in Human-Robot Interaction

Garcia, Fernando; Jacq, Alexis; Lemaignan, S.; Dillenbourg, Pierre

Abstract

© 2016 IEEE. Measuring "how much the human is in the interaction" - the level of engagement - is instrumental in building effective interactive robots. Engagement, however, is a complex, multi-faceted cognitive mechanism that is only indirectly observable. This article formalizes with-me-ness as one of such indirect measures. With-me-ness, a concept borrowed from the field of Computer-Supported Collaborative Learning, measures in a welldefined way to what extent the human is with the robot over the course of an interactive task. As such, it is a meaningful precursor of engagement. We expose in this paper the full methodology, from real-time estimation of the human's focus of attention (relying on a novel, open-source, vision-based head pose estimator), to on-line computation of with-me-ness. We report as well on the experimental validation of this approach, using a naturalistic setup involving children during a complex robotteaching task.

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: ACM/IEEE International Conference on Human-Robot Interaction
• Acceptance Date: Oct 10, 2015
• Online Publication Date: Apr 14, 2016
• Publication Date: Apr 14, 2016
• Deposit Date: May 1, 2018
• Publicly Available Date: May 1, 2018
• Journal: 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI)
• Print ISSN: 2167-2148
• Electronic ISSN: 2167-2148
• Peer Reviewed: Peer Reviewed
• Pages: 157-164
• Book Title: Proceedings of the 2016 ACM/IEEE Human-Robot Interaction Conference
• DOI: https://doi.org/10.1109/HRI.2016.7451747
• Keywords: human-robot interaction, visual focus of attention, with-me-ness, real-time head pose estimation, robots , face, visualization, real-time systems, three-dimensional displays, estimation
• Public URL: https://uwe-repository.worktribe.com/output/913345
• Publisher URL: http://dx.doi.org/10.1109/HRI.2016.7451747
• Additional Information: Additional Information : (c) 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.; Title of Conference or Conference Proceedings : Human-Robot Interaction
• Contract Date: May 1, 2018