All Outputs (53)

The ballad of the bots: Sonification using cognitive metaphor to support immersed teleoperation of robot teams (2024)
Journal Article

As an embodied and spatial medium, virtual reality is proving an attractive proposition for robot teleoperation in hazardous environments. This paper examines a nuclear decommissioning scenario in which a simulated team of semi-autonomous robots are... Read More about The ballad of the bots: Sonification using cognitive metaphor to support immersed teleoperation of robot teams.

The impact of data sonification in virtual reality robot teleoperation (2022)
Journal Article

Virtual Reality (VR) is being increasingly used to provide a more intuitive and embodied approach to robotic teleoperation, giving operators a sense of presence in the remote environment. Prior research has shown that presence can be enhanced when ad... Read More about The impact of data sonification in virtual reality robot teleoperation.

Survival of the synthesis—GPU accelerating evolutionary sound matching (2022)
Journal Article

Manually configuring synthesizer parameters to reproduce a particular sound is a complex and challenging task. Researchers have previously used different optimization algorithms, including evolutionary algorithms to find optimal sound matching soluti... Read More about Survival of the synthesis—GPU accelerating evolutionary sound matching.

Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback (2021)
Journal Article

A key challenge in achieving effective robot teleoperation is minimizing teleoperators’ cognitive workload and fatigue. We set out to investigate the extent to which gaze tracking data can reveal how teleoperators interact with a system. In this stud... Read More about Assessing the Role of Gaze Tracking in Optimizing Humans-In-The-Loop Telerobotic Operation Using Multimodal Feedback.

There and Back Again: The Practicality of GPU Accelerated Digital Audio (2020)
Presentation / Conference Contribution

General-Purpose GPU computing is becoming an increas-ingly viable option for acceleration, including in the audiodomain. Although it can improve performance, the intrin-sic nature of a device like the GPU involves data transfersand execution commands... Read More about There and Back Again: The Practicality of GPU Accelerated Digital Audio.

Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment (2019)
Presentation / Conference Contribution

In this paper we explore the recreation of existing musical compositions by representing the music as a series of unique musical bars, and other bars that can be replicated through various algorithmic transformations, inside the Interactive Generativ... Read More about Automating algorithmic representations of musical structure using IGME: The Interactive Generative Music Environment.

The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes (2019)
Presentation / Conference Contribution

Touretteshero is the name of a organisation that aims to raise awareness of Tourette's syndrome by sharing and celebrating the creativity and humor of the involuntary vocal and movement tics that characterise the condition. This paper documents the d... Read More about The alchemy of chaos: A sound art sonification of a year of Tourette’s episodes.

Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework (2019)
Journal Article

© 2019 Author(s). As molecular scientists have made progress in their ability to engineer nanoscale molecular structure, we face new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differ... Read More about Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework.

Return to temperament (In digital systems) (2018)
Presentation / Conference Contribution

Considering the generation of musical tunings, it is reasonable to expect that the many constructs contained in Functional programming languages may provide useful tools for exploring both conventional and new tunings. In this paper we present a numb... Read More about Return to temperament (In digital systems).

Simple mappings, expressive movement: a qualitative investigation into the end-user mapping design of experienced mid-air musicians (2018)
Journal Article

© 2018, © 2018 Informa UK Limited, trading as Taylor & Francis Group. In a New Interface for Musical Expression (NIME), the design of the relationship between a musician’s actions and the instrument’s sound response is critical in creating instrume... Read More about Simple mappings, expressive movement: a qualitative investigation into the end-user mapping design of experienced mid-air musicians.

A cognitive dimensions approach for the design of an interactive generative score editor (2018)
Presentation / Conference Contribution

This paper describes how the Cognitive Dimensions of Notation can guide the design of algorithmic composition tools. Prior research has also used the cognitive dimensions for analysing interaction design for algorithmic composition software. This wor... Read More about A cognitive dimensions approach for the design of an interactive generative score editor.

How can music visualisation techniques reveal different perspectives on musical structure? (2017)
Presentation / Conference Contribution

Standard western notation supports the understanding and performance of music, but has limited provisions for revealing overall musical characteristics and structure. This paper presents several visualisers for highlighting and providing insights int... Read More about How can music visualisation techniques reveal different perspectives on musical structure?.

A user experience review of music interaction evaluations (2017)
Presentation / Conference Contribution

The need for thorough evaluations is an emerging area of interest and importance in music interaction research. As a large degree of DMI evaluation is concerned with exploring the subjective experience: ergonomics, action-sound mappings and control i... Read More about A user experience review of music interaction evaluations.

Expressive gestural personality (2017)
Book Chapter

n/a

Danceroom spectroscopy: At the frontiers of physics, performance, interactive art and technology (2016)
Journal Article

© 2016 ISAST. Danceroom Spectroscopy is an interactive audiovisual art installation and performance system driven by rigorous algorithms commonly used to simulate and analyze nanoscale atomic dynamics. danceroom Spectroscopy interprets humans as “ene... Read More about Danceroom spectroscopy: At the frontiers of physics, performance, interactive art and technology.

GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor (2016)
Journal Article

This paper presents GestureChords, a mapping strategy for chord selection in freehand gestural instruments. The strategy maps chord variations to a series of hand postures using the concepts of iconicity and conceptual metaphor, influenced by their u... Read More about GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor.

Simple synchronisation for open sound control (2015)
Presentation / Conference Contribution

Clock synchronisation is a mature and important aspect of distributed computing systems. Despite the importance of accurate timing in music, there are relatively few widely applicable synchronisation solutions available to computer music practitioner... Read More about Simple synchronisation for open sound control.

Turnector: Tangible control widgets for capacitive touchscreen devices (2014)
Presentation / Conference Contribution

This paper details the development of Turnector, a control system based upon tangible widgets that are manipulated on the touchscreen of a capacitive touch device. Turnector widgets are modelled on rotary faders and aim to connect the user to paramet... Read More about Turnector: Tangible control widgets for capacitive touchscreen devices.

Controlling physically based virtual musical instruments using the gloves (2014)
Presentation / Conference Contribution

In this paper we propose an empirical method to develop mapping strategies between a gestural-based interface (the Gloves) and physically based sound synthesis models. An experiment was conducted to investigate which gestures listeners associate with... Read More about Controlling physically based virtual musical instruments using the gloves.

A GPU-accelerated immersive audio-visual framework for interaction with molecular dynamics using consumer depth sensors (2014)
Journal Article

© the Partner Organisations 2014. With advances in computational power, the rapidly growing role of computational/simulation methodologies in the physical sciences, and the development of new human-computer interaction technologies, the field of inte... Read More about A GPU-accelerated immersive audio-visual framework for interaction with molecular dynamics using consumer depth sensors.