Towards molecular musical instruments: Interactive sonifications of 17-alanine, graphene and carbon nanotubes

Mitchell, Thomas J.; Jones, Alex J.; O�Connor, Michael B.; Wonnacott, Mark D.; Glowacki, David R.; Hyde, Joseph

Abstract

Scientists increasingly rely on computational models of atoms and molecules to observe, understand and make predictions about the microscopic world. Atoms and molecules are in constant motion, with vibrations and structural fluctuations occurring at very short time-scales and corresponding length-scales. But can these microscopic oscillations be converted into sound? And, what would they sound like? In this paper we present our initial steps towards a generalised approach for sonifying data produced by a real-time molecular dynamics simulation. The approach uses scanned synthesis to translate real-time geometric simulation data into audio. The process is embedded within a stand alone application as well as a variety of audio plugin formats to enable the process to be used as an audio synthesis method for music making. We review the relevant background literature before providing an overview of our system. Simulations of three molecules are then considered: 17-alanine, graphene and a carbon nanotube. Four examples are then provided demonstrating how the technique maps molecular features and parameters onto the auditory character of the resulting sound. A case study is then provided in which the sonification/synthesis method is used within a musical composition.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: AM '20: 15th International Conference on Audio Mostly
• Start Date: Sep 15, 2020
• End Date: Sep 17, 2020
• Acceptance Date: Jul 3, 2020
• Publication Date: Sep 15, 2020
• Deposit Date: Sep 8, 2020
• Publicly Available Date: Sep 16, 2020
• Pages: 214-221
• Series Title: ACM International Audio Mostly Conference (AM’20) Proceeding Series
• Book Title: AM '20: Proceedings of the 15th International Conference on Audio Mostly
• ISBN: 9781450375634
• DOI: https://doi.org/10.1145/3411109.3411143
• Keywords: virtual reality, augmented reality, sonification, game audio, spa-tial audio, sonic interaction design, musicology, sound art
• Public URL: https://uwe-repository.worktribe.com/output/6666451
• Publisher URL: https://audiomostly.com/2020/