Data acquisition towards defining a multimodal interaction model for human-assistive robot communication

Fotinea, Stavroula-Evita; Efthimiou, Eleni; Dimou, Athanasia-Lida; Goulas, Theo; Karioris, Panayotis; Peer, Angelika; Maragos, Petros; Tzafestas, Costas; Kokkinos, Iasonas; Hauer, Klaus; Mombaur, Katja; Koumpouros, Ioannis; Stanzyk, Bartlomiej

Abstract

We report on the procedures followed in order to acquire a multimodal sensory corpus that will become the primary source of data retrieval, data analysis and testing of mobility assistive robot prototypes in the European project MOBOT. Analysis of the same corpus with respect to all sensorial data will lead to the definition of the multimodal interaction model; gesture and audio data analysis is foreseen to be integrated into the platform in order to facilitate the communication channel between end users and the assistive robot prototypes expected to be the project’s outcomes. In order to allow estimation of the whole range of sensorial data acquired, we will refer to the data acquisition scenarios followed in order to obtain the required multisensory data and to the initial post-processing outcomes currently available.

Citation

Fotinea, S., Efthimiou, E., Dimou, A., Goulas, T., Karioris, P., Peer, A., …Stanzyk, B. Data acquisition towards defining a multimodal interaction model for human-assistive robot communication. Paper presented at Universal Access in Human/Computer Interaction. Aging and Assistive Environments, UAHCI/HCII

• Presentation Conference Type: Conference Paper (unpublished)
• Conference Name: Universal Access in Human/Computer Interaction. Aging and Assistive Environments, UAHCI/HCII
• Acceptance Date: Jun 22, 2014
• Publication Date: Jan 1, 2014
• Peer Reviewed: Peer Reviewed
• Keywords: assistive robot, natural HRI, multimodal communication model,; multisensory data acquisition
• Additional Information: Title of Conference or Conference Proceedings : Universal Access in Human/Computer Interaction. Aging and Assistive Environments, UAHCI/HCII