SoundGrasp: A gestural interface for the performance of live music

Mitchell, Thomas J.

Abstract

This paper documents the first developmental phase of an interface that enables the performance of live music using gestures and body movements. The work included focuses on the first step of this project: the composition and performance of live music using hand gestures captured using a single data glove. The paper provides a background to the field, the aim of the project and a technical description of the work completed so far. This includes the development of a robust posture vocabulary, an artificial neural network-based posture identification process and a state-based system to map identified postures onto a set of performance processes. The paper is closed with qualitative usage observations and a projection of future plans.

• Presentation Conference Type: Poster
• Conference Name: Proceedings of the International Conference on New Interfaces for Musical Expression, 30 May - 1 June 2011, Oslo, Norway
• Start Date: May 30, 2011
• End Date: Jun 1, 2011
• Publication Date: Jan 1, 2011
• Deposit Date: Jan 9, 2013
• Publicly Available Date: Nov 15, 2016
• Peer Reviewed: Peer Reviewed
• Keywords: gestural music, music controller, data glove, neural network, live music composition, looping, Imogen Heap
• Public URL: https://uwe-repository.worktribe.com/output/970457
• Publisher URL: http://www.nime2011.org/proceedings/papers/M13-Mitchell.pdf
• Additional Information: Title of Conference or Conference Proceedings : International Conference on New Interfaces for Musical Expression (NIME) 2011
• Contract Date: Nov 15, 2016