Squishy, yet satisfying: Exploring deformable shapes' cross-modal correspondences with colours and emotions

Steer, Cameron; Sauvé, Kim; Jain, Anika; Lawal, Omosunmisola; Proulx, Michael J.; Jicol, Crescent; Alexander, Jason

Abstract

Surfaces with deformable and shape-changing properties seek to enhance and diversify tangible interactions with computing systems. However, we currently lack fundamental knowledge and user interface design principles that connect the inherent properties of deformable shapes with our human senses and cognitive associations. To address this knowledge gap, we systematically explored deformable shapes' cross-modal correspondences (CC) with colours and emotions. In our CC study, 52 participants were presented with deformable shape stimuli that varied in stiffness and angularity. They were asked to associate these stimuli with colours and emotions under (i) visuo-tactile and; (ii) tactile-only conditions. For the first time, our findings reveal (1) how stiffness level primarily influences the CC associations and; (2) that stiffness and angularity play a significant role in CC associations over the visibility of the shapes. The results were distilled into design guidelines for future deformable, shape-changing interfaces that engage specific human senses and responses.

• Presentation Conference Type: Conference Paper (published)
• Conference Name: CHI '24: CHI Conference on Human Factors in Computing Systems
• Start Date: May 13, 2024
• End Date: May 17, 2024
• Acceptance Date: Jan 18, 2024
• Online Publication Date: May 11, 2024
• Publication Date: May 11, 2024
• Deposit Date: May 13, 2024
• Publisher: Association for Computing Machinery (ACM)
• Pages: 1-20
• Book Title: CHI '24: Proceedings of the CHI Conference on Human Factors in Computing Systems
• ISBN: 9798400703300
• DOI: https://doi.org/10.1145/3613904.3641952
• Keywords: Colour, Crossmodal Correspondences, Deformable, Emotion, Force, Shape, Tactile-only Touch, Visuo-tactile
• Public URL: https://uwe-repository.worktribe.com/output/11986553
• Publisher URL: https://dl.acm.org/doi/10.1145/3613904.3641952
• Additional Information: Published: 2024-05-11