Skip to main content

Research Repository

Advanced Search

GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor

Brown, Dom; Nash, Chris; Mitchell, Tom

Authors

Dom Brown dom.brown@uwe.ac.uk

Chris Nash Chris.Nash@uwe.ac.uk
Senior Lecturer in Music Tech - Software Development

Tom Mitchell Tom.Mitchell@uwe.ac.uk
Associate Professor in Creative Technologies



Abstract

This paper presents GestureChords, a mapping strategy for chord selection in freehand gestural instruments. The strategy maps chord variations to a series of hand postures using the concepts of iconicity and conceptual metaphor, influenced by their use in American Sign Language (ASL), to encode meaning in gestural signs. The mapping uses the conceptual metaphors MUSICAL NOTES ARE POINTS IN SPACE and INTERVALS BETWEEN NOTES ARE SPACES BETWEEN POINTS, which are mapped respectively to the number of extended fingers in a performer’s hand and the abduction or adduction between them. The strategy is incorporated into a digital musical instrument and tested in a preliminary study for transparency by both performers and spectators, which gave promising results for the technique.

Journal Article Type Article
Start Date Aug 30, 2016
Publication Date Jan 1, 2016
Journal Proceedings SMC 2016
Print ISSN 2518-3672
Peer Reviewed Peer Reviewed
Pages 85-92
APA6 Citation Brown, D., Nash, C., & Mitchell, T. (2016). GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor
Keywords gestural interaction, digital musical instrument, American Sign Language, iconicity, conceptual metaphor
Publisher URL http://www.georghajdu.de/computermusicnotation/wopre/wp-content/uploads/smc/SMC2016_proceedings_final-2.pdf
Additional Information Title of Conference or Conference Proceedings : The Proceedings of the 13th Sound and Music Computing Conference

Files





You might also like



Downloadable Citations

;