Participatory conceptual design of accessible digital musical instruments using generative AI

Aynsley, Hugh; Mitchell, Thomas J; Meckin, Dave

Abstract

This paper explores the potential of AI text-to-image diffusion models (e.g. DALLE-2 and Midjourney) to support the early phase design of new digital musical instruments in collaboration with Disabled musicians. The paper presents initial findings from two speculative design workshops attended by Disabled participants who are affiliated with the London-based inclusive arts organisation Joy of Sound. The workshops included activities that enabled participants to co-create speculative images of new instruments, drawing on their own contributions. These included the overall appearance of the instrument, constituent materials and other design characteristics. The paper discusses the generated images and examines how diffusion models can be a useful tool to support the conceptual co-design phase of bespoke accessible instruments. The project findings indicate that diffusion models can be useful as a facilitatory tool for idea generation in the initial stages of instrument design.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: NIME 2023
• Start Date: May 31, 2023
• End Date: Jun 2, 2023
• Acceptance Date: Mar 16, 2023
• Online Publication Date: May 31, 2023
• Publication Date: May 31, 2023
• Deposit Date: May 19, 2023
• Publicly Available Date: Jul 1, 2023
• Article Number: 83
• Pages: 579-583
• Series ISSN: 2220-4806
• Book Title: Proceedings of the International Conference on New Interfaces for Musical Expression
• DOI: https://doi.org/10.5281/zenodo.11189302
• Keywords: AI, ADMI, Accessibility, Participatory Design, AI CCS Concepts, Human-centered computing, Accessibility, Accessibility design and evaluation methods, Human-centered computing, Interaction design, Interaction design process and methods, Participatory design
• Public URL: https://uwe-repository.worktribe.com/output/10798868