Skip to main content

Research Repository

Advanced Search

All Outputs (48)

Automatically Classifying User Engagement for Dynamic Multi-party Human–Robot Interaction (2017)
Journal Article
Foster, M. E., Gaschler, A., & Giuliani, M. (2017). Automatically Classifying User Engagement for Dynamic Multi-party Human–Robot Interaction. International Journal of Social Robotics, 9(5), 659-674. https://doi.org/10.1007/s12369-017-0414-y

© 2017, The Author(s). A robot agent designed to engage in real-world human–robot joint action must be able to understand the social states of the human users it interacts with in order to behave appropriately. In particular, in a dynamic public spac... Read More about Automatically Classifying User Engagement for Dynamic Multi-party Human–Robot Interaction.

To err is robot: How humans assess and act toward an erroneous social robot (2017)
Journal Article
Mirnig, N., Stollnberger, G., Miksch, M., Stadler, S., Giuliani, M., & Tscheligi, M. (2017). To err is robot: How humans assess and act toward an erroneous social robot. Frontiers in Robotics and AI, 4(MAY), 21. https://doi.org/10.3389/frobt.2017.00021

© 2017 Mirnig, Stollnberger, Miksch, Stadler, Giuliani and Tscheligi. We conducted a user study for which we purposefully programmed faulty behavior into a robot's routine. It was our aim to explore if participants rate the faulty robot different fro... Read More about To err is robot: How humans assess and act toward an erroneous social robot.

Industrial human-robot interaction: Creating personas for augmented reality supported robot control and teaching (2017)
Presentation / Conference
Stadler, S., Mirnig, N., Giuliani, M., Tscheligi, M., Materna, Z., & Kapinus, M. (2017, March). Industrial human-robot interaction: Creating personas for augmented reality supported robot control and teaching. Paper presented at ACM/IEEE International Conference on Human-Robot Interaction 2017, Vienna, Austria

In strong cooperation with small and medium-sized enterprises (SMEs), we research the simplification of industrial robot online-programming. For that, we extend existing programming interfaces with augmented reality (AR) technology. We proactively us... Read More about Industrial human-robot interaction: Creating personas for augmented reality supported robot control and teaching.

Tablet-based augmented reality in the factory: Influence of knowledge in computer programming on robot teaching tasks (2017)
Presentation / Conference
Kain, K. S., Stadler, S., Giuliani, M., Mirnig, N., Stollnberger, G., & Tscheligi, M. (2017, March). Tablet-based augmented reality in the factory: Influence of knowledge in computer programming on robot teaching tasks. Paper presented at ACM/IEEE International Conference on Human-Robot Interaction 2017, Vienna, Austria

We investigate whether a user’s background in computer programming has an influence on user’s mental workload, when using a tablet-based augmented reality robot control interface that visualizes task-based information. For this purpose we conducted a... Read More about Tablet-based augmented reality in the factory: Influence of knowledge in computer programming on robot teaching tasks.

Elements of humor: How humans perceive verbal and non-verbal aspects of humorous robot behavior (2017)
Presentation / Conference
Mirnig, N., Stollnberger, G., Giuliani, M., & Tscheligi, M. (2017, March). Elements of humor: How humans perceive verbal and non-verbal aspects of humorous robot behavior. Paper presented at ACM/IEEE International Conference on Human-Robot Interaction 2017, Vienna, Austria

We performed a preliminary online survey to explore if verbal and non-verbal robot humor elements influence how humans rate a robot's funniness. The video-based survey comprised four conditions, each showing a short clip of a NAO robot in a receptio... Read More about Elements of humor: How humans perceive verbal and non-verbal aspects of humorous robot behavior.

Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace (2017)
Presentation / Conference
Materna, Z., Kapinus, M., Beran, V., Smrž, P., Giuliani, M., Mirnig, N., …Tscheligi, M. (2017, March). Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace. Paper presented at ACM/IEEE International Conference on Human-Robot Interaction 2017, Vienna, Austria

Up to date, methods from Human-Computer Interaction (HCI) have not been widely adopted in the development of Human-Robot Interaction systems (HRI). In this paper, we describe a system prototype and a use case. The prototype is an augmented reality-ba... Read More about Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace.

Designing user interfaces for different user groups: A three-way teleconference system for doctors, patients and assistants using a Remote Medical robot (2016)
Conference Proceeding
Zarczuk, R., Kreczmer, B., Wysokinski, A., Stollnberger, G., Giuliani, M., Mirnig, N., …Andrzej, W. (2016). Designing user interfaces for different user groups: A three-way teleconference system for doctors, patients and assistants using a Remote Medical robot. . https://doi.org/10.1109/ROMAN.2016.7745181

© 2016 IEEE. We present the design for a three-way medical teleconference system for communication between a doctor, a patient, and an assistant. The system includes individual doctor-patient and doctor-assistant communication channels, as well as th... Read More about Designing user interfaces for different user groups: A three-way teleconference system for doctors, patients and assistants using a Remote Medical robot.

Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability (2016)
Conference Proceeding
Mirnig, N., Stadler, S., Stollnberger, G., Giuliani, M., & Tscheligi, M. (2016). Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability. . https://doi.org/10.1109/ROMAN.2016.7745106

© 2016 IEEE. Humor in robotics is a promising, though not yet significantly researched topic. We performed a user study exploring two different kinds of laughter. In our study, participants observed a robot-robot interaction where an iCat and a NAO r... Read More about Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability.

User requirements for a medical robotic system: Enabling doctors to remotely conduct ultrasonography and physical examination (2016)
Conference Proceeding
Moser, C., Stollnberger, G., Christiane, M., Giuliani, M., Stadler, S., Tscheligi, M., …Stanczyk, B. (2016). User requirements for a medical robotic system: Enabling doctors to remotely conduct ultrasonography and physical examination. . https://doi.org/10.1109/ROMAN.2016.7745254

© 2016 IEEE. We report the results of a user requirements analysis for a medical robotic system that enables doctors to remotely conduct ultrasonography and physical examination on patients. As there are three different user groups in this scenario -... Read More about User requirements for a medical robotic system: Enabling doctors to remotely conduct ultrasonography and physical examination.

Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control (2016)
Conference Proceeding
Stadler, S., Kain, K., Giuliani, M., Mirnig, N., Stollnberger, G., & Tscheligi, M. (2016). Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control. . https://doi.org/10.1109/ROMAN.2016.7745108

© 2016 IEEE. Augmented reality (AR) can serve as a tool to provide helpful information in a direct way to industrial robot programmers throughout the teaching process. It seems obvious that AR support eases the programming process and increases the p... Read More about Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control.

Control of mobile robot for remote medical examination: Design concepts and users' feedback from experimental studies (2016)
Conference Proceeding
Wysokinski, A., Szczesniak-Stanczyk, D., Cholewinski, M., Drwiega, M., Arent, K., Jakubiak, J., …Wysokiński, A. (2016). Control of mobile robot for remote medical examination: Design concepts and users' feedback from experimental studies. . https://doi.org/10.1109/HSI.2016.7529612

© 2016 IEEE. In this article we discuss movement control of a ReMeDi medical mobile robot from the user perspective. The control is essentially limited to the level of operator actions where the operator is a member of a nursing staff. Two working mo... Read More about Control of mobile robot for remote medical examination: Design concepts and users' feedback from experimental studies.

Systematic analysis of video data from different human-robot interaction studies: A categorisation of social signals during error situations (2015)
Journal Article
Giuliani, M., Mirnig, N., Stollnberger, G., Stadler, S., Buchner, R., & Tscheligi, M. (2015). Systematic analysis of video data from different human-robot interaction studies: A categorisation of social signals during error situations. Frontiers in Psychology, 6(931), https://doi.org/10.3389/fpsyg.2015.00931

Human–robot interactions are often affected by error situations that are caused by either the robot or the human. Therefore, robots would profit from the ability to recognize when error situations occur. We investigated the verbal and non-verbal soci... Read More about Systematic analysis of video data from different human-robot interaction studies: A categorisation of social signals during error situations.

Multi-modality gesture detection and recognition with un-supervision, randomization and discrimination (2015)
Journal Article
Wu, D., Chen, G., Clarke, D., Weikersdorfer, D., Giuliani, M., Gaschler, A., & Knoll, A. (2015). Multi-modality gesture detection and recognition with un-supervision, randomization and discrimination. Lecture Notes in Artificial Intelligence, 8925, 608-622. https://doi.org/10.1007/978-3-319-16178-5_43

© Springer International Publishing Switzerland 2015. We describe in this paper our gesture detection and recognition system for the 2014 ChaLearn Looking at People (Track 3: Gesture Recognition) organized by ChaLearn in conjunction with the ECCV 201... Read More about Multi-modality gesture detection and recognition with un-supervision, randomization and discrimination.

Ghost-in-the-Machine reveals human social signals for human-robot interaction (2015)
Journal Article
Loth, S., Jettka, K., Giuliani, M., & De Ruiter, J. P. (2015). Ghost-in-the-Machine reveals human social signals for human-robot interaction. Frontiers in Psychology, 6(NOV), https://doi.org/10.3389/fpsyg.2015.01641

© 2015 Loth, Jettka, Giuliani and de Ruiter. We used a new method called "Ghost-in-the-Machine" (GiM) to investigate social interactions with a robotic bartender taking orders for drinks and serving them. Using the GiM paradigm allowed us to identify... Read More about Ghost-in-the-Machine reveals human social signals for human-robot interaction.

An RGB-D based social behavior interpretation system for a humanoid social robot (2014)
Presentation / Conference
Zaraki, A., Giuliani, M., Dehkordi, M. B., Mazzei, D., D'ursi, A., & Rossi, D. D. (2014, October). An RGB-D based social behavior interpretation system for a humanoid social robot. Paper presented at 2nd RSI International Conference on Robotics and Mechatronics (ICRoM 2014), Tehran, Iran

We used a new method called “Ghost-in-the-Machine” (GiM) to investigate social interactions with a robotic bartender taking orders for drinks and serving them. Using the GiM paradigm allowed us to identify how human participants recognize the intenti... Read More about An RGB-D based social behavior interpretation system for a humanoid social robot.

Combining unsupervised learning and discrimination for 3D action recognition (2014)
Journal Article
Chen, G., Clarke, D., Giuliani, M., Gaschler, A., & Knoll, A. (2015). Combining unsupervised learning and discrimination for 3D action recognition. Signal Processing, 110, 67-81. https://doi.org/10.1016/j.sigpro.2014.08.024

© 2014 Elsevier B.V. Previous work on 3D action recognition has focused on using hand-designed features, either from depth videos or 2D videos. In this work, we present an effective way to combine unsupervised feature learning with discriminative fea... Read More about Combining unsupervised learning and discrimination for 3D action recognition.

Designing and evaluating a social gaze-control system for a humanoid robot (2014)
Journal Article
Zaraki, A., Mazzei, D., Giuliani, M., & De Rossi, D. (2014). Designing and evaluating a social gaze-control system for a humanoid robot. IEEE Transactions on Human-Machine Systems, 44(2), 157-168. https://doi.org/10.1109/THMS.2014.2303083

This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attenti... Read More about Designing and evaluating a social gaze-control system for a humanoid robot.

Action recognition using ensemble weighted multi-instance learning (2014)
Journal Article
Chen, G., Giuliani, M., Clarke, D., Gaschler, A., & Knoll, A. (2014). Action recognition using ensemble weighted multi-instance learning. IEEE International Conference on Robotics and Automation, 4520-4525. https://doi.org/10.1109/ICRA.2014.6907519

© 2014 IEEE. This paper deals with recognizing human actions in depth video data. Current state-of-the-art action recognition methods use hand-designed features, which are difficult to produce and time-consuming to extend to new modalities. In this p... Read More about Action recognition using ensemble weighted multi-instance learning.

Task-based evaluation of context-sensitive referring expressions in human–robot dialogue (2014)
Journal Article
Foster, M. E., Giuliani, M., & Isard, A. (2014). Task-based evaluation of context-sensitive referring expressions in human–robot dialogue. Language Cognition and Neuroscience, 29(8), 1018-1034. https://doi.org/10.1080/01690965.2013.855802

© 2013 Taylor & Francis. The standard referring-expression generation task involves creating stand-alone descriptions intended solely to distinguish a target object from its context. However, when an artificial system refers to objects in the cours... Read More about Task-based evaluation of context-sensitive referring expressions in human–robot dialogue.

How can I help you? Comparing engagement classification strategies for a robot bartender (2013)
Presentation / Conference
Foster, M. E., Gaschler, A., & Giuliani, M. (2013, December). How can I help you? Comparing engagement classification strategies for a robot bartender. Paper presented at 15th International Conference on Multimodal Interfaces (ICMI 2013), Sydney, Australia

A robot agent existing in the physical world must be able to understand the social states of the human users it interacts with in order to respond appropriately. We compared two implemented methods for estimating the engagement state of customers for... Read More about How can I help you? Comparing engagement classification strategies for a robot bartender.