Dom Brown
GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor
Brown, Dom; Nash, Chris; Mitchell, Tom
Authors
Chris Nash Chris.Nash@uwe.ac.uk
Senior Lecturer in Music Tech - Software Development
Tom Mitchell Tom.Mitchell@uwe.ac.uk
Professor of Audio and Music Interaction
Abstract
This paper presents GestureChords, a mapping strategy for chord selection in freehand gestural instruments. The strategy maps chord variations to a series of hand postures using the concepts of iconicity and conceptual metaphor, influenced by their use in American Sign Language (ASL), to encode meaning in gestural signs. The mapping uses the conceptual metaphors MUSICAL NOTES ARE POINTS IN SPACE and INTERVALS BETWEEN NOTES ARE SPACES BETWEEN POINTS, which are mapped respectively to the number of extended fingers in a performer’s hand and the abduction or adduction between them. The strategy is incorporated into a digital musical instrument and tested in a preliminary study for transparency by both performers and spectators, which gave promising results for the technique.
Citation
Brown, D., Nash, C., & Mitchell, T. (2016). GestureChords: Transparency in gesturally controlled digital musical instruments through iconicity and conceptual metaphor
Journal Article Type | Article |
---|---|
Conference Name | Sound and Music Computing |
Conference Location | Hamburg, Germany |
Start Date | Aug 30, 2016 |
End Date | Sep 3, 2016 |
Acceptance Date | Jun 24, 2016 |
Publication Date | Jan 1, 2016 |
Deposit Date | Aug 3, 2016 |
Publicly Available Date | Sep 8, 2016 |
Journal | Proceedings SMC 2016 |
Print ISSN | 2518-3672 |
Peer Reviewed | Peer Reviewed |
Pages | 85-92 |
Keywords | gestural interaction, digital musical instrument, American Sign Language, iconicity, conceptual metaphor |
Public URL | https://uwe-repository.worktribe.com/output/917262 |
Publisher URL | http://www.georghajdu.de/computermusicnotation/wopre/wp-content/uploads/smc/SMC2016_proceedings_final-2.pdf |
Additional Information | Title of Conference or Conference Proceedings : The Proceedings of the 13th Sound and Music Computing Conference |
Files
smc2016template.pdf
(2 Mb)
PDF
You might also like
Automatic for the people: Crowd-driven generative scores using Manhattan and machine vision
(2021)
Conference Proceeding
Automatic for the people: Two pieces of crowd-driven music
(2021)
Exhibition / Performance
Creativity in children's digital music composition
(2021)
Conference Proceeding
Was that me?: Exploring the effects of error in gestural digital musical instruments
(2020)
Conference Proceeding
Crowd-driven music: Interactive and generative approaches using machine vision and Manhattan
(2020)
Conference Proceeding
Downloadable Citations
About UWE Bristol Research Repository
Administrator e-mail: repository@uwe.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search