Manuel Giuliani's Outputs (45)

Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data (2022)
Journal Article

This paper makes a contribution to research on digital twins that are generated from robot sensor data. We present the results of an online user study in which 240 participants were tasked to identify real-world objects from robot point cloud data. I... Read More about Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data.

Mutual shaping in swarm robotics: User studies in fire and rescue, storage organization, and bridge inspection (2020)
Journal Article

Many real-world applications have been suggested in the swarm robotics literature. However, there is a general lack of understanding of what needs to be done for robot swarms to be useful and trusted by users in reality. This paper aims to investigat... Read More about Mutual shaping in swarm robotics: User studies in fire and rescue, storage organization, and bridge inspection.

User-centred design and evaluation of a tele-operated echocardiography robot (2020)
Journal Article

We present the collected findings of a user-centred approach for developing a tele-operated robot for remote echocardiography examinations. During the three-year development of the robot, we involved users in all development stages of the robot, to i... Read More about User-centred design and evaluation of a tele-operated echocardiography robot.

Confidence in uncertainty: Error cost and commitment in early speech hypotheses (2018)
Journal Article

© 2018 Loth et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credi... Read More about Confidence in uncertainty: Error cost and commitment in early speech hypotheses.

Towards a cognitive architecture incorporating human feedback for interactive collaborative robots (2018)
Journal Article

The development of new collaborative robotic platforms opens the new possibility of human-robot collaborative scenarios provided that they are controlled by excellent control programs. Interactive collaborative robots need to be autonomous and posses... Read More about Towards a cognitive architecture incorporating human feedback for interactive collaborative robots.

Automatically Classifying User Engagement for Dynamic Multi-party Human–Robot Interaction (2017)
Journal Article

© 2017, The Author(s). A robot agent designed to engage in real-world human–robot joint action must be able to understand the social states of the human users it interacts with in order to behave appropriately. In particular, in a dynamic public spac... Read More about Automatically Classifying User Engagement for Dynamic Multi-party Human–Robot Interaction.

To err is robot: How humans assess and act toward an erroneous social robot (2017)
Journal Article

© 2017 Mirnig, Stollnberger, Miksch, Stadler, Giuliani and Tscheligi. We conducted a user study for which we purposefully programmed faulty behavior into a robot's routine. It was our aim to explore if participants rate the faulty robot different fro... Read More about To err is robot: How humans assess and act toward an erroneous social robot.

Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace (2017)
Presentation / Conference Contribution

Up to date, methods from Human-Computer Interaction (HCI) have not been widely adopted in the development of Human-Robot Interaction systems (HRI). In this paper, we describe a system prototype and a use case. The prototype is an augmented reality-ba... Read More about Using persona, scenario, and use case to develop a human-robot augmented reality collaborative workspace.

Systematic analysis of video data from different human-robot interaction studies: A categorisation of social signals during error situations (2015)
Journal Article

Human–robot interactions are often affected by error situations that are caused by either the robot or the human. Therefore, robots would profit from the ability to recognize when error situations occur. We investigated the verbal and non-verbal soci... Read More about Systematic analysis of video data from different human-robot interaction studies: A categorisation of social signals during error situations.

Ghost-in-the-Machine reveals human social signals for human-robot interaction (2015)
Journal Article

© 2015 Loth, Jettka, Giuliani and de Ruiter. We used a new method called "Ghost-in-the-Machine" (GiM) to investigate social interactions with a robotic bartender taking orders for drinks and serving them. Using the GiM paradigm allowed us to identify... Read More about Ghost-in-the-Machine reveals human social signals for human-robot interaction.

Combining unsupervised learning and discrimination for 3D action recognition (2014)
Journal Article

© 2014 Elsevier B.V. Previous work on 3D action recognition has focused on using hand-designed features, either from depth videos or 2D videos. In this work, we present an effective way to combine unsupervised feature learning with discriminative fea... Read More about Combining unsupervised learning and discrimination for 3D action recognition.

Designing and evaluating a social gaze-control system for a humanoid robot (2014)
Journal Article

This paper describes a context-dependent social gaze-control system implemented as part of a humanoid social robot. The system enables the robot to direct its gaze at multiple humans who are interacting with each other and with the robot. The attenti... Read More about Designing and evaluating a social gaze-control system for a humanoid robot.

Task-based evaluation of context-sensitive referring expressions in human–robot dialogue (2014)
Journal Article

© 2013 Taylor & Francis. The standard referring-expression generation task involves creating stand-alone descriptions intended solely to distinguish a target object from its context. However, when an artificial system refers to objects in the cours... Read More about Task-based evaluation of context-sensitive referring expressions in human–robot dialogue.

Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction (2013)
Journal Article

We present a robot that is working with humans on a common construction task. In this kind of interaction, it is important that the robot can perform different roles in order to realise an efficient collaboration. For this, we introduce embodied mult... Read More about Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction.

Design principles for safety in human-robot interaction (2010)
Journal Article

The interaction of humans and robots has the potential to set new grounds in industrial applications as well as in service robotics because it combines the strengths of humans, such as flexibility and adaptability, and the strengths of robots, such a... Read More about Design principles for safety in human-robot interaction.

Combining goal inference and natural-language dialogue for human-robot joint action (2008)
Presentation / Conference Contribution

We demonstrate how combining the reasoning components
from two existing systems designed for human-robot joint action produces an integrated system with greater capabilities than either of the individual systems. One of the systems supports primaril... Read More about Combining goal inference and natural-language dialogue for human-robot joint action.

Action recognition using ensemble weighted multi-instance learning
Presentation / Conference Contribution

© 2014 IEEE. This paper deals with recognizing human actions in depth video data. Current state-of-the-art action recognition methods use hand-designed features, which are difficult to produce and time-consuming to extend to new modalities. In this p... Read More about Action recognition using ensemble weighted multi-instance learning.

Immersive control of a robot surrogate for users in palliative care
Presentation / Conference Contribution

Quality of life (QoL) is especially important for palliative care patients, who can be at risk of mental health issues. This project aims to design and implement an immersive control system for a robotic surrogate, that allows users to interact as na... Read More about Immersive control of a robot surrogate for users in palliative care.

Modelling state of interaction from head poses for social human-robot interaction
Presentation / Conference Contribution

In this publication, we analyse how humans use head pose in various states of an interaction, in both human-human and human-robot observations. Our scenario is the short-term, every-day interaction of a customer ordering a drink from a bartender. To... Read More about Modelling state of interaction from head poses for social human-robot interaction.

Comparing objective and subjective measures of usability in a human-robot dialogue system
Presentation / Conference Contribution

We present a human-robot dialogue system that enables a robot to work together with a human user to build wooden construction toys. We then describe a study in which na¨ıve subjects interacted with this system under a range of conditions and then com... Read More about Comparing objective and subjective measures of usability in a human-robot dialogue system.

A debris clearance robot for extreme environments
Presentation / Conference Contribution

© Springer Nature Switzerland AG 2019. The need for nuclear decommissioning is increasing globally, as power stations and other facilities utilising nuclear reaches the end of their operational life. Currently the majority of decommissioning tasks ar... Read More about A debris clearance robot for extreme environments.

The effect of virtual reality control of a robotic surrogate on presence and social presence in comparison to telecommunications software
Presentation / Conference Contribution

Telecommunication software is often used to tackle social isolation in those with restricted mobility, but lacks high-level interactions found in face-to-face conversation. This study investigated the use of an immersive control system for a robotic... Read More about The effect of virtual reality control of a robotic surrogate on presence and social presence in comparison to telecommunications software.

Physiological data measurement in digital manufacturing
Presentation / Conference Contribution

As industry is moving towards a new digital rev-olution, identifying workers' mental and physical status is key to improved productivity in a digital manufacturing scenario. The main objective here is to provide an overview of sensing technologies in... Read More about Physiological data measurement in digital manufacturing.

Static and temporal differences in social signals between error-free and erroneous situations in human-robot collaboration
Presentation / Conference Contribution

The capability of differentiating error situations from error-free situations in human-robot collaboration is a mandatory skill for collaborative robots. One of the variables that robots can analyse to differentiate both situations are the social sig... Read More about Static and temporal differences in social signals between error-free and erroneous situations in human-robot collaboration.

Examining profiles for robotic risk assessment: Does a robot's approach to risk affect user trust?
Presentation / Conference Contribution

© 2020 Association for Computing Machinery. As autonomous robots move towards ubiquity, the need for robots to make decisions under risk that are trustworthy becomes increasingly significant; both to aid acceptance and to fully utilise their autonomo... Read More about Examining profiles for robotic risk assessment: Does a robot's approach to risk affect user trust?.

Measuring visual social engagement from proxemics and gaze
Presentation / Conference Contribution

When we approach a group, there is an exchange of a multitude of verbal or non-verbal social signals to indicate that we are looking to interact. We continue to share these signals throughout the interaction to portray our thoughts and motivations. W... Read More about Measuring visual social engagement from proxemics and gaze.

User requirements for a robot teleoperation system for general medical examination
Presentation / Conference Contribution

Thailand, as well as many other countries world-wide, is facing a shortage of medical staff. We purpose a solution to improve medical services in health centres: a robot teleoperation system to allow patients to consult with doctors from public hospi... Read More about User requirements for a robot teleoperation system for general medical examination.

Usability study of a novel triple-arm mixed-reality robot teleoperation system
Presentation / Conference Contribution

The usability of a novel triple-arm mixed-reality robot teleoperation system is investigated. The system is developed to provide a sense of remote presence for the operator. Different types of interfaces and camera setups have been proposed previousl... Read More about Usability study of a novel triple-arm mixed-reality robot teleoperation system.

Haptic teleoperation goes wireless: Evaluation and benchmarking of a high-performance low-power wireless control technology
Presentation / Conference Contribution

Communication delays and packet losses are commonly investigated issues in the area of robotic teleoperation. This paper investigates application of a novel low-power wireless control technology (GALLOP) in a haptic teleoperation scenario developed t... Read More about Haptic teleoperation goes wireless: Evaluation and benchmarking of a high-performance low-power wireless control technology.

Demo: Untethered haptic teleoperation for nuclear decommissioning using a low-power wireless control technology
Presentation / Conference Contribution

Haptic teleoperation is typically realized through wired networking technologies (e.g., Ethernet) which guarantee performance of control loops closed over the communication medium, particularly in terms of latency, jitter, and reliability. This demon... Read More about Demo: Untethered haptic teleoperation for nuclear decommissioning using a low-power wireless control technology.

Multi-modality gesture detection and recognition with un-supervision, randomization and discrimination
Presentation / Conference Contribution

© Springer International Publishing Switzerland 2015. We describe in this paper our gesture detection and recognition system for the 2014 ChaLearn Looking at People (Track 3: Gesture Recognition) organized by ChaLearn in conjunction with the ECCV 201... Read More about Multi-modality gesture detection and recognition with un-supervision, randomization and discrimination.

An RGB-D based social behavior interpretation system for a humanoid social robot
Presentation / Conference Contribution

We used a new method called “Ghost-in-the-Machine” (GiM) to investigate social interactions with a robotic bartender taking orders for drinks and serving them. Using the GiM paradigm allowed us to identify how human participants recognize the intenti... Read More about An RGB-D based social behavior interpretation system for a humanoid social robot.

How can I help you? Comparing engagement classification strategies for a robot bartender
Presentation / Conference Contribution

A robot agent existing in the physical world must be able to understand the social states of the human users it interacts with in order to respond appropriately. We compared two implemented methods for estimating the engagement state of customers for... Read More about How can I help you? Comparing engagement classification strategies for a robot bartender.

Unsupervised learning spatio-temporal features for human activity recognition from RGB-D video data
Presentation / Conference Contribution

Being able to recognize human activities is essential for several applications, including social robotics. The recently developed commodity depth sensors open up newpossibilities of dealingwith this problem. Existing techniques extract hand-tuned fea... Read More about Unsupervised learning spatio-temporal features for human activity recognition from RGB-D video data.

Two people walk into a bar: Dynamic multi-party social interaction with a robot agent
Presentation / Conference Contribution

We introduce a humanoid robot bartender that is capable of dealing with multiple customers in a dynamic, multi-party social setting. The robot system incorporates state-of-the-art components for computer vision, linguistic processing, state managemen... Read More about Two people walk into a bar: Dynamic multi-party social interaction with a robot agent.

Tablet-based augmented reality in the factory: Influence of knowledge in computer programming on robot teaching tasks
Presentation / Conference Contribution

We investigate whether a user’s background in computer programming has an influence on user’s mental workload, when using a tablet-based augmented reality robot control interface that visualizes task-based information. For this purpose we conducted a... Read More about Tablet-based augmented reality in the factory: Influence of knowledge in computer programming on robot teaching tasks.

Elements of humor: How humans perceive verbal and non-verbal aspects of humorous robot behavior
Presentation / Conference Contribution

We performed a preliminary online survey to explore if verbal and non-verbal robot humor elements influence how humans
rate a robot's funniness. The video-based survey comprised four conditions, each showing a short clip of a NAO robot in a receptio... Read More about Elements of humor: How humans perceive verbal and non-verbal aspects of humorous robot behavior.

Industrial human-robot interaction: Creating personas for augmented reality supported robot control and teaching
Presentation / Conference Contribution

In strong cooperation with small and medium-sized enterprises (SMEs), we research the simplification of industrial robot online-programming. For that, we extend existing programming interfaces with augmented reality (AR) technology. We proactively us... Read More about Industrial human-robot interaction: Creating personas for augmented reality supported robot control and teaching.

Head and shoulders: Automatic error detection in human-robot interaction
Presentation / Conference Contribution

We describe a novel method for automatic detection of errors in human-robot interactions. Our approach is to detect errors based on the classification of head and shoulder movements of humans who are interacting with erroneous robots. We conducted a... Read More about Head and shoulders: Automatic error detection in human-robot interaction.

Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability
Presentation / Conference Contribution

© 2016 IEEE. Humor in robotics is a promising, though not yet significantly researched topic. We performed a user study exploring two different kinds of laughter. In our study, participants observed a robot-robot interaction where an iCat and a NAO r... Read More about Robot humor: How self-irony and Schadenfreude influence people's rating of robot likability.

Control of mobile robot for remote medical examination: Design concepts and users' feedback from experimental studies
Presentation / Conference Contribution

© 2016 IEEE. In this article we discuss movement control of a ReMeDi medical mobile robot from the user perspective. The control is essentially limited to the level of operator actions where the operator is a member of a nursing staff. Two working mo... Read More about Control of mobile robot for remote medical examination: Design concepts and users' feedback from experimental studies.

Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control
Presentation / Conference Contribution

© 2016 IEEE. Augmented reality (AR) can serve as a tool to provide helpful information in a direct way to industrial robot programmers throughout the teaching process. It seems obvious that AR support eases the programming process and increases the p... Read More about Augmented reality for industrial robot programmers: Workload analysis for task-based, augmented reality-supported robot control.

User requirements for a medical robotic system: Enabling doctors to remotely conduct ultrasonography and physical examination
Presentation / Conference Contribution

© 2016 IEEE. We report the results of a user requirements analysis for a medical robotic system that enables doctors to remotely conduct ultrasonography and physical examination on patients. As there are three different user groups in this scenario -... Read More about User requirements for a medical robotic system: Enabling doctors to remotely conduct ultrasonography and physical examination.

Designing user interfaces for different user groups: A three-way teleconference system for doctors, patients and assistants using a Remote Medical robot
Presentation / Conference Contribution

© 2016 IEEE. We present the design for a three-way medical teleconference system for communication between a doctor, a patient, and an assistant. The system includes individual doctor-patient and doctor-assistant communication channels, as well as th... Read More about Designing user interfaces for different user groups: A three-way teleconference system for doctors, patients and assistants using a Remote Medical robot.

Evaluating description and reference strategies in a cooperative human-robot dialogue system
Presentation / Conference Contribution

We present a human-robot dialogue system that enables a robot to work together with a human user to build wooden construction toys. We then describe a study which assessed the responses of na¨ıve users to output that varied along two dimensions: the... Read More about Evaluating description and reference strategies in a cooperative human-robot dialogue system.