Dom Brown
GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor
Brown, Dom; Nash, Chris; Mitchell, Tom
Authors
Chris Nash Chris.Nash@uwe.ac.uk
Senior Lecturer in Music Tech - Software Development
Tom Mitchell Tom.Mitchell@uwe.ac.uk
Associate Professor in Creative Technologies
Abstract
This paper presents GestureChords, a mapping strategy for chord selection in freehand gestural instruments. The strategy maps chord variations to a series of hand postures using the concepts of iconicity and conceptual metaphor, influenced by their use in American Sign Language (ASL), to encode meaning in gestural signs. The mapping uses the conceptual metaphors MUSICAL NOTES ARE POINTS IN SPACE and INTERVALS BETWEEN NOTES ARE SPACES BETWEEN POINTS, which are mapped respectively to the number of extended fingers in a performer’s hand and the abduction or adduction between them. The strategy is incorporated into a digital musical instrument and tested in a preliminary study for transparency by both performers and spectators, which gave promising results for the technique.
Citation
Brown, D., Nash, C., & Mitchell, T. (2016). GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor
Journal Article Type | Article |
---|---|
Conference Name | Sound and Music Computing |
Start Date | Aug 30, 2016 |
End Date | Sep 3, 2016 |
Acceptance Date | Jun 24, 2016 |
Publication Date | Jan 1, 2016 |
Journal | Proceedings SMC 2016 |
Print ISSN | 2518-3672 |
Peer Reviewed | Peer Reviewed |
Pages | 85-92 |
Keywords | gestural interaction, digital musical instrument, American Sign Language, iconicity, conceptual metaphor |
Public URL | https://uwe-repository.worktribe.com/output/917262 |
Publisher URL | http://www.georghajdu.de/computermusicnotation/wopre/wp-content/uploads/smc/SMC2016_proceedings_final-2.pdf |
Additional Information | Title of Conference or Conference Proceedings : The Proceedings of the 13th Sound and Music Computing Conference |
Files
smc2016template.pdf
(2 Mb)
PDF
You might also like
A user experience review of music interaction evaluations
(2017)
Presentation / Conference
Leimu: Gloveless music interaction using a wrist mounted leap motion
(2016)
Presentation / Conference
Was that me?: Exploring the effects of error in gestural digital musical instruments
(2020)
Conference Proceeding