All Outputs (50)

Hear here: Sonification as a design strategy for robot teleoperation using virtual reality (2023)
Conference Proceeding
Simmons, J., Bown, A., Bremner, P., McIntosh, V., & Mitchell, T. J. (2023). Hear here: Sonification as a design strategy for robot teleoperation using virtual reality.

This paper introduces a novel methodology for the sonification of data, and shares the results of a usability study, putting the method- ology into practice within an industrial use case. Working with partners at Sellafield nuclear facility, we explo... Read More about Hear here: Sonification as a design strategy for robot teleoperation using virtual reality.

Participatory conceptual design of accessible digital musical instruments using generative AI (2023)
Conference Proceeding
Aynsley, H., Mitchell, T. J., & Meckin, D. (in press). Participatory conceptual design of accessible digital musical instruments using generative AI.

This paper explores the potential of AI text-to-image diffusion models (e.g. DALLE-2 and Midjourney) to support the early phase design of new digital musical instruments in collaboration with Disabled musicians. The paper presents initial findings fr... Read More about Participatory conceptual design of accessible digital musical instruments using generative AI.

The impact of data sonification in virtual reality robot teleoperation (2022)
Journal Article
Bremner, P., Mitchell, T. J., & McIntosh, V. (2022). The impact of data sonification in virtual reality robot teleoperation. Frontiers in Virtual Reality, 3, 904720. https://doi.org/10.3389/frvir.2022.904720

Virtual Reality (VR) is being increasingly used to provide a more intuitive and embodied approach to robotic teleoperation, giving operators a sense of presence in the remote environment. Prior research has shown that presence can be enhanced when ad... Read More about The impact of data sonification in virtual reality robot teleoperation.

Studying how digital luthiers choose their tools (2022)
Conference Proceeding
Renney, N., Renney, H., Mitchell, T. J., & Gaster, B. R. (2022). Studying how digital luthiers choose their tools. . https://doi.org/10.1145/3491102.3517656

Digital lutherie is a sub-domain of digital craft focused on creating digital musical instruments: high-performance devices for musical expression. It represents a nuanced and challenging area of human-computer interaction that is well established an... Read More about Studying how digital luthiers choose their tools.

HyperModels - A framework for GPU accelerated physical modelling sound synthesis (2022)
Conference Proceeding
Renney, H., Willemsen, S., Gaster, B. R., & Mitchell, T. J. (2022). HyperModels - A framework for GPU accelerated physical modelling sound synthesis. . https://doi.org/10.21428/92fbeb44.98a4210a

Physical modelling sound synthesis methods generate vast and intricate sound spaces that are navigated using meaningful parameters. Numerical based physical modelling nsynthesis methods provide authentic representations of the physics they model. Unf... Read More about HyperModels - A framework for GPU accelerated physical modelling sound synthesis.

Survival of the synthesis—GPU accelerating evolutionary sound matching (2022)
Journal Article
Renney, H., Gaster, B., & Mitchell, T. J. (2022). Survival of the synthesis—GPU accelerating evolutionary sound matching. Concurrency and Computation: Practice and Experience, 34(10), Article e6824. https://doi.org/10.1002/cpe.6824

Manually configuring synthesizer parameters to reproduce a particular sound is a complex and challenging task. Researchers have previously used different optimization algorithms, including evolutionary algorithms to find optimal sound matching soluti... Read More about Survival of the synthesis—GPU accelerating evolutionary sound matching.

Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback (2021)
Journal Article
Bolarinwa, J., Eimontaite, I., Mitchell, T., Dogramadzi, S., & Caleb-Solly, P. (2021). Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback. Frontiers in Robotics and AI, 8, Article 578596. https://doi.org/10.3389/frobt.2021.578596

A key challenge in achieving effective robot teleoperation is minimizing teleoperators’ cognitive workload and fatigue. We set out to investigate the extent to which gaze tracking data can reveal how teleoperators interact with a system. In this stud... Read More about Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback.

Was that me?: Exploring the effects of error in gestural digital musical instruments (2020)
Conference Proceeding
Brown, D., Nash, C., & Mitchell, T. J. (2020). Was that me?: Exploring the effects of error in gestural digital musical instruments. In AM '20: Proceedings of the 15th International Conference on Audio Mostly (168-174). https://doi.org/10.1145/3411109.3411137

Traditional Western musical instruments have evolved to be robust and predictable, responding consistently to the same player actions with the same musical response. Consequently, errors occurring in a performance scenario are typically attributed to... Read More about Was that me?: Exploring the effects of error in gestural digital musical instruments.

Towards molecular musical instruments: Interactive sonifications of 17-alanine, graphene and carbon nanotubes (2020)
Conference Proceeding
Mitchell, T. J., Jones, A. J., O’Connor, M. B., Wonnacott, M. D., Glowacki, D. R., & Hyde, J. (2020). Towards molecular musical instruments: Interactive sonifications of 17-alanine, graphene and carbon nanotubes. In AM '20: Proceedings of the 15th International Conference on Audio Mostly (214-221). https://doi.org/10.1145/3411109.3411143

Scientists increasingly rely on computational models of atoms and molecules to observe, understand and make predictions about the microscopic world. Atoms and molecules are in constant motion, with vibrations and structural fluctuations occurring at... Read More about Towards molecular musical instruments: Interactive sonifications of 17-alanine, graphene and carbon nanotubes.

There and Back Again: The Practicality of GPU Accelerated Digital Audio (2020)
Presentation / Conference
Renney, H., Gaster, B. R., & Mitchell, T. J. (2020, July). There and Back Again: The Practicality of GPU Accelerated Digital Audio. Paper presented at NIME’20: Proceedings of the 20th New Interfaces for Musical Expression, Online

General-Purpose GPU computing is becoming an increas-ingly viable option for acceleration, including in the audiodomain. Although it can improve performance, the intrin-sic nature of a device like the GPU involves data transfersand execution commands... Read More about There and Back Again: The Practicality of GPU Accelerated Digital Audio.

Composing computer generated music, an observational study using IGME: the Interactive Generative Music Environment (2020)
Conference Proceeding
Hunt, S. J., Mitchell, T. J., & Nash, C. (2020). Composing computer generated music, an observational study using IGME: the Interactive Generative Music Environment.

Computer composed music remains a novel and challenging problem to solve. Despite an abundance of techniques and systems little research has explored how these might be useful for end-users looking to compose with generative and algorithmic music tec... Read More about Composing computer generated music, an observational study using IGME: the Interactive Generative Music Environment.

Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment (2019)
Presentation / Conference
Hunt, S. J., Mitchell, T., & Nash, C. (2019, December). Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment. Paper presented at Innovation In Music 2019, University of West London

In this paper we explore the recreation of existing musical compositions by representing the music as a series of unique musical bars, and other bars that can be replicated through various algorithmic transformations, inside the Interactive Generativ... Read More about Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment.

The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes (2019)
Presentation / Conference
Mitchell, T. J., Thom, J., Pountney, M., & Hyde, J. (2019, June). The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes. Paper presented at The 25th International Conference on Auditory Display (ICAD 2019), Northumbria University, Northumbria, England

Touretteshero is the name of a organisation that aims to raise awareness of Tourette's syndrome by sharing and celebrating the creativity and humor of the involuntary vocal and movement tics that characterise the condition. This paper documents the d... Read More about The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes.

Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework (2019)
Journal Article
O’Connor, M. B., Bennie, S. J., Deeks, H. M., Jamieson-Binnie, A., Jones, A. J., Shannon, R. J., …Glowacki, D. R. (2019). Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework. Journal of Chemical Physics, 150(22), https://doi.org/10.1063/1.5092590

© 2019 Author(s). As molecular scientists have made progress in their ability to engineer nanoscale molecular structure, we face new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differ... Read More about Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework.

OpenCL vs: Accelerated finite-difference digital synthesis (2019)
Conference Proceeding
Renney, H., Gaster, B. R., & Mitchell, T. (2019). OpenCL vs: Accelerated finite-difference digital synthesis. . https://doi.org/10.1145/3318170.3318172

© 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM. Digital audio synthesis has become an important component of modern music production with techniques that can produce realistic simulations of real instruments. Physica... Read More about OpenCL vs: Accelerated finite-difference digital synthesis.

Return to temperament (In digital systems) (2018)
Presentation / Conference
Renney, N., Gaster, B., & Mitchell, T. (2018, September). Return to temperament (In digital systems). Paper presented at Audio Mostly, Wrexham, Wales

Considering the generation of musical tunings, it is reasonable to expect that the many constructs contained in Functional programming languages may provide useful tools for exploring both conventional and new tunings. In this paper we present a numb... Read More about Return to temperament (In digital systems).

Outside the block syndicate: Translating Faust's algebra of blocks to the arrows framework (2018)
Presentation / Conference
Gaster, B. R., Renney, N., & Mitchell, T. (2018, July). Outside the block syndicate: Translating Faust's algebra of blocks to the arrows framework. Paper presented at Proceedings of the 1st International Faust Conference (IFC-18), Mainz, Germany

Folklore has it that Faust’s algebra of blocks can be represented in Hughes’ algebra of Arrows. In this paper we formalise this understanding, showing that blocks can indeed be encoded with Causal Commutative Arrows. Whilst an interesting finding in... Read More about Outside the block syndicate: Translating Faust's algebra of blocks to the arrows framework.

Simple mappings, expressive movement: a qualitative investigation into the end-user mapping design of experienced mid-air musicians (2018)
Journal Article
Brown, D., Nash, C., & Mitchell, T. (2018). Simple mappings, expressive movement: a qualitative investigation into the end-user mapping design of experienced mid-air musicians. Digital Creativity, 29(2-3), 129-148. https://doi.org/10.1080/14626268.2018.1510841

© 2018, © 2018 Informa UK Limited, trading as Taylor & Francis Group. In a New Interface for Musical Expression (NIME), the design of the relationship between a musician’s actions and the instrument’s sound response is critical in creating instrume... Read More about Simple mappings, expressive movement: a qualitative investigation into the end-user mapping design of experienced mid-air musicians.

Understanding user-defined mapping design in mid-air musical performance (2018)
Conference Proceeding
Brown, D., Nash, C., & Mitchell, T. (2018). Understanding user-defined mapping design in mid-air musical performance. https://doi.org/10.1145/3212721.3212810

© 2018 Copyright held by the owner/author(s). Publication rights licensed to Association for Computing Machinery. Modern gestural interaction and motion capture technology is frequently incorporated into Digital Musical Instruments (DMIs) to enable n... Read More about Understanding user-defined mapping design in mid-air musical performance.

Sonifying stochastic walks on biomolecular energy landscapes (2018)
Presentation / Conference
Arbon, R. E., Jones, A. J., Bratholm, L. A., Mitchell, T., & Glowacki, D. R. (2018, June). Sonifying stochastic walks on biomolecular energy landscapes. Paper presented at International Conference On Auditory Display 2018, Michigan Technological University, Houghton, US

Translating the complex, multi-dimensional data produced by simulations of biomolecules into an intelligible form is a major challenge in computational chemistry and biology. The so-called “free energy landscape” is amongst the most fundamental conce... Read More about Sonifying stochastic walks on biomolecular energy landscapes.