Skip to main content

Research Repository

Advanced Search

Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data

Bremner, Paul; Giuliani, Manuel

Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data Thumbnail


Authors

Paul Bremner Paul2.Bremner@uwe.ac.uk
Associate Professor in Human Robotics Interactions

Manuel Giuliani Manuel.Giuliani@uwe.ac.uk
Co- Director Bristol Robotics Laboratory



Abstract

This paper makes a contribution to research on digital twins that are generated from robot sensor data. We present the results of an online user study in which 240 participants were tasked to identify real-world objects from robot point cloud data. In the study we manipulated the render style (point clouds vs voxels), render resolution (i.e., density of point clouds and granularity of voxel grids), colour (monochrome vs coloured points/voxels), and motion (no motion vs rotational motion) of the shown objects to measure the impact of these attributes on object recognition performance. A statistical analysis of the study results suggests that there is a three-way interaction between our independent variables. Further analysis suggests: 1) objects are easier to recognise when rendered as point clouds than when rendered as voxels, particularly lower resolution voxels; 2) the effect of colour and motion is affected by how objects are rendered, e.g., utility of colour decreases with resolution for point clouds; 3) an increased resolution of point clouds only leads to an increased object recognition if points are coloured and static; 4) high resolution voxels outperform medium and low resolution voxels in all conditions, but there is little difference between medium and low resolution voxels; 5) motion is unable to improve the performance of voxels at low and medium resolutions, but is able to improve performance for medium and low resolution point clouds. Our results have implications for the design of robot sensor suites and data gathering and transmission protocols when creating digital twins from robot gathered point cloud data.

Citation

Bremner, P., & Giuliani, M. (2022). Impact of resolution, colour, and motion on object identification in digital twins from robot sensor data. Frontiers in Robotics and AI, 9, Article 995342. https://doi.org/10.3389/frobt.2022.995342

Journal Article Type Article
Acceptance Date Oct 10, 2022
Online Publication Date Oct 28, 2022
Publication Date Oct 28, 2022
Deposit Date Nov 23, 2022
Publicly Available Date Mar 29, 2024
Journal Frontiers in Robotics and AI
Electronic ISSN 2296-9144
Publisher Frontiers Media
Peer Reviewed Peer Reviewed
Volume 9
Article Number 995342
DOI https://doi.org/10.3389/frobt.2022.995342
Keywords Robotics and AI, digital twins, robot, point clouds, voxels, user study
Public URL https://uwe-repository.worktribe.com/output/10148563
Publisher URL https://www.frontiersin.org/articles/10.3389/frobt.2022.995342/full
Related Public URLs The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/frobt.2022.995342/full#supplementary-material

Files




You might also like



Downloadable Citations