Tom Mitchell's Outputs (53)

The ballad of the bots: Sonification using cognitive metaphor to support immersed teleoperation of robot teams (2024)
Journal Article

As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are... Read More about The ballad of the bots: Sonification using cognitive metaphor to support immersed teleoperation of robot teams.

A systematic review of reverberation and accessibility for B/blind users in virtual environments (2023)
Presentation / Conference Contribution

Reverberation is often used in linear and non-linear media to convey the acoustic characteristics of a space. This information is presented alongside visual stimuli to create a multi-modal experience, assisting participants in developing visual and a... Read More about A systematic review of reverberation and accessibility for B/blind users in virtual environments.

Hear here: Sonification as a design strategy for robot teleoperation using virtual reality (2023)
Presentation / Conference Contribution

This paper introduces a novel methodology for the sonification of data, and shares the results of a usability study, putting the method- ology into practice within an industrial use case. Working with partners at Sellafield nuclear facility, we explo... Read More about Hear here: Sonification as a design strategy for robot teleoperation using virtual reality.

Participatory conceptual design of accessible digital musical instruments using generative AI (2023)
Presentation / Conference Contribution

This paper explores the potential of AI text-to-image diffusion models (e.g. DALLE-2 and Midjourney) to support the early phase design of new digital musical instruments in collaboration with Disabled musicians. The paper presents initial findings fr... Read More about Participatory conceptual design of accessible digital musical instruments using generative AI.

The impact of data sonification in virtual reality robot teleoperation (2022)
Journal Article

Virtual Reality (VR) is being increasingly used to provide a more intuitive and embodied approach to robotic teleoperation, giving operators a sense of presence in the remote environment. Prior research has shown that presence can be enhanced when ad... Read More about The impact of data sonification in virtual reality robot teleoperation.

Studying how digital luthiers choose their tools (2022)
Presentation / Conference Contribution

Digital lutherie is a sub-domain of digital craft focused on creating digital musical instruments: high-performance devices for musical expression. It represents a nuanced and challenging area of human-computer interaction that is well established an... Read More about Studying how digital luthiers choose their tools.

HyperModels - A framework for GPU accelerated physical modelling sound synthesis (2022)
Presentation / Conference Contribution

Physical modelling sound synthesis methods generate vast and intricate sound spaces that are navigated using meaningful parameters. Numerical based physical modelling nsynthesis methods provide authentic representations of the physics they model. Unf... Read More about HyperModels - A framework for GPU accelerated physical modelling sound synthesis.

Survival of the synthesis—GPU accelerating evolutionary sound matching (2022)
Journal Article

Manually configuring synthesizer parameters to reproduce a particular sound is a complex and challenging task. Researchers have previously used different optimization algorithms, including evolutionary algorithms to find optimal sound matching soluti... Read More about Survival of the synthesis—GPU accelerating evolutionary sound matching.

Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback (2021)
Journal Article

A key challenge in achieving effective robot teleoperation is minimizing teleoperators’ cognitive workload and fatigue. We set out to investigate the extent to which gaze tracking data can reveal how teleoperators interact with a system. In this stud... Read More about Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback.

Towards molecular musical instruments: Interactive sonifications of 17-alanine, graphene and carbon nanotubes (2020)
Presentation / Conference Contribution

Scientists increasingly rely on computational models of atoms and molecules to observe, understand and make predictions about the microscopic world. Atoms and molecules are in constant motion, with vibrations and structural fluctuations occurring at... Read More about Towards molecular musical instruments: Interactive sonifications of 17-alanine, graphene and carbon nanotubes.

Was that me?: Exploring the effects of error in gestural digital musical instruments (2020)
Presentation / Conference Contribution

Traditional Western musical instruments have evolved to be robust and predictable, responding consistently to the same player actions with the same musical response. Consequently, errors occurring in a performance scenario are typically attributed to... Read More about Was that me?: Exploring the effects of error in gestural digital musical instruments.

There and Back Again: The Practicality of GPU Accelerated Digital Audio (2020)
Presentation / Conference Contribution

General-Purpose GPU computing is becoming an increas-ingly viable option for acceleration, including in the audiodomain. Although it can improve performance, the intrin-sic nature of a device like the GPU involves data transfersand execution commands... Read More about There and Back Again: The Practicality of GPU Accelerated Digital Audio.

Composing computer generated music, an observational study using IGME: the Interactive Generative Music Environment (2020)
Presentation / Conference Contribution

Computer composed music remains a novel and challenging problem to solve. Despite an abundance of techniques and systems little research has explored how these might be useful for end-users looking to compose with generative and algorithmic music tec... Read More about Composing computer generated music, an observational study using IGME: the Interactive Generative Music Environment.

Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment (2019)
Presentation / Conference Contribution

In this paper we explore the recreation of existing musical compositions by representing the music as a series of unique musical bars, and other bars that can be replicated through various algorithmic transformations, inside the Interactive Generativ... Read More about Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment.

The use of different feedback modalities and verbal collaboration in tele-robotic assistance (2019)
Presentation / Conference Contribution

This paper explores the effects of different feedback modalities (gripper orientation via peripheral (side) vision and haptic feedback) and verbal collaboration with the service-user on the performance of tele-operators in completing a tele-robotic a... Read More about The use of different feedback modalities and verbal collaboration in tele-robotic assistance.

The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes (2019)
Presentation / Conference Contribution

Touretteshero is the name of a organisation that aims to raise awareness of Tourette's syndrome by sharing and celebrating the creativity and humor of the involuntary vocal and movement tics that characterise the condition. This paper documents the d... Read More about The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes.

Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework (2019)
Journal Article

© 2019 Author(s). As molecular scientists have made progress in their ability to engineer nanoscale molecular structure, we face new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differ... Read More about Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework.

OpenCL vs: Accelerated finite-difference digital synthesis (2019)
Presentation / Conference Contribution

© 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM. Digital audio synthesis has become an important component of modern music production with techniques that can produce realistic simulations of real instruments. Physica... Read More about OpenCL vs: Accelerated finite-difference digital synthesis.

Return to temperament (In digital systems) (2018)
Presentation / Conference Contribution

Considering the generation of musical tunings, it is reasonable to expect that the many constructs contained in Functional programming languages may provide useful tools for exploring both conventional and new tunings. In this paper we present a numb... Read More about Return to temperament (In digital systems).

Outside the block syndicate: Translating Faust's algebra of blocks to the arrows framework (2018)
Presentation / Conference Contribution

Folklore has it that Faust’s algebra of blocks can be represented in Hughes’ algebra of Arrows. In this paper we formalise this understanding, showing that blocks can indeed be encoded with Causal Commutative Arrows.
Whilst an interesting finding in... Read More about Outside the block syndicate: Translating Faust's algebra of blocks to the arrows framework.