Benedict Gaster Benedict.Gaster@uwe.ac.uk
Associate Professor in Physical Computing
Nathan Renney Nathan.Renney@uwe.ac.uk
Lecturer in Computer Science
Maisie Palmer
Abstract
This paper explores the design and use of a camera-based digital musical instrument as a thinking tool for considering entangled, post-human perspectives. The design of the pattern organ, inspired by experimental optical sound-on-film practices, employs a method of visual-to-audio synthesis that responds closely to the material behaviours captured by its camera input.
Drawing on findings from exploratory workshops and short material experiments, we describe how interactions emerge and are shaped by both the physical configuration of the instrument and the material behaviours captured by its camera. We consider how frugal mappings and the ‘rawness’ of data can give rise to instruments whose inputs remain open to material complexity, extending the sound engine beyond their enclosures.
Presentation Conference Type
Conference Paper (unpublished)
Conference Name
The International Conference on New Interfaces for Musical Expression
Start Date
Jun 24, 2025
End Date
Jun 27, 2025
Acceptance Date
Apr 25, 2025
Deposit Date
Apr 27, 2025
Publicly Available Date
Apr 25, 2025
Peer Reviewed
Peer Reviewed
Keywords
Entanglement; Materialism; Post-Humanism; Audification; Opti- cal Sound; DMI Design
