Leimu: Gloveless music interaction using a wrist mounted leap motion

Brown, Dom; Renney, Nathan; Stark, Adam; Nash, Chris; Mitchell, Tom

Abstract

Camera-based motion tracking has become a popular enabling technology for gestural human-computer interaction. However, the approach suffers from several limitations, which have been shown to be particularly problematic when employed within musical contexts. This paper presents Leimu, a wrist mount that couples a Leap Motion optical sensor with an inertial measurement unit to combine the benefits of wearable and camera-based motion tracking. Leimu is designed, developed and then evaluated using discourse and statistical analysis methods. Qualitative results indicate that users consider Leimu to be an effective interface for gestural music interaction and the quantitative results demonstrate that the interface offers improved tracking precision over a Leap Motion positioned on a table top.

Citation

Brown, D., Renney, N., Stark, A., Nash, C., & Mitchell, T. (2016, July). Leimu: Gloveless music interaction using a wrist mounted leap motion. Paper presented at The International Conference On New Interfaces for Musical Expression NIME2016, Brisbane, Australia

• Presentation Conference Type: Conference Paper (unpublished)
• Conference Name: The International Conference On New Interfaces for Musical Expression NIME2016
• Conference Location: Brisbane, Australia
• Start Date: Jul 11, 2016
• End Date: Jul 15, 2016
• Acceptance Date: Mar 29, 2016
• Publication Date: Jan 1, 2016
• Deposit Date: May 4, 2016
• Publicly Available Date: Nov 14, 2016
• Peer Reviewed: Peer Reviewed
• Keywords: leap motion, gestural control, digital musical instruments, IMU, wearable technology, motion tracking, data gloves
• Public URL: https://uwe-repository.worktribe.com/output/917273
• Publisher URL: http://www.nime.org
• Additional Information: Title of Conference or Conference Proceedings : Proceedings of the International Conference On New Interfaces for Musical Expression NIME2016