In this paper, we describe a novel electronic musical interface, consisting of a strand-like object that can be physically transformed by bending to create various shapes and signifiers. Users are encouraged to explore a visual language in a musical context, as each new shape portrays a different musical instrument with unique sonic behavior. We apply concepts from research in the area of cross-modal perception as guidance for mapping shapes and signifiers to corresponding sounds.
Irmandy Wicaksono, Caroline Rozendo, Runzhou Ye, Jaleesa Trapp, V. Michael Bove Jr., Canan Dagdeviren, and Hiroshi Ishii. 2018. PerForm: Deformable Interface for Exploring Sound through Shapes. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18). ACM, New York, NY, USA, Paper LBW605, 6 pages. DOI: https://doi.org/10.1145/3170427.3188478