Our malleable input surface is made of a cut garden-variety rubber glove. This rubber sheet is stretched tautly over a rigid frame to form a flat interaction surface. A video camera is positioned underneath to capture input information applied to the rubber sheet.
By applying the hands and fingers onto the interaction surface, deformations are made that can be appropriately lit and captured using a video camera. By patterning the surface underneath with dots, position and depth tracking can be performed through computing the changes in displacement and area for each dot. The video capture and processing is done with ImageJ plugins.
Our input device exhibits two attributes of whole-hand surface based interfaces: multi-point sensitivity and depth/pressure sensing. These are made possible through computer vision. Our interface also offers passive haptic feedback from the malleable nature of the surface
Florian Vogt, Timothy Chen, Reynald Hoskinson, and Sidney Fels. 2004. A malleable surface touch interface. In ACM SIGGRAPH 2004 Sketches(SIGGRAPH ’04), Ronen Barzel (Ed.). ACM, New York, NY, USA, 36-. DOI: https://doi.org/10.1145/1186223.1186268