In our project, Clay Tone, we focus on the conversion of shapes into sounds. Clay Tone is a sound generation system that can be manipulated by physically handling bodies of clay. We propose a novel form of interaction, where the shapes of freely deformable lumps, and the user’s physical movements against them, can affect the manner in which sounds are generated from the system. By
utilizing familiar materials as elements of manipulation, we have achieved an intuitive interaction scheme. With Clay Tone, we aim to create a new kind of clay play that ties itself with music, encouraging imagination. Expression with clay is enjoyable and visual. Users can easily share or appreciate an image of a sound with another person. Through changing sounds dependent on the form and softness of clay, we can experience a fusion of touch, sight, and hearing.
Eri Watanabe, Yuta Hanzawa, and Masa Inakage. 2007. Clay tone: a music system using clay for user interaction. In ACM SIGGRAPH 2007 posters(SIGGRAPH ’07). ACM, New York, NY, USA, , Article 156 . DOI: https://doi.org/10.1145/1280720.1280890