A new projection-based mixed reality technique for augmenting deformable surfaces with deformation rendering graphics. DeforMe combines a geometry tracking method with a deformation reconstruction model to estimate the tangential deformation of a surface. The motions of the feature points are measured between two successive frames. Moreover, the system estimates the surface deformation on the basis of the moving least squares algorithm, and interpolates the deformation estimation result to the projected graphics. Users can interact in real time with the deformable object, while the realistic projected graphics deform according to the deformation of the surface. We aim to integrate our technique with various types of design-support and interactive applications in spatial augmented reality.

Credits: Punpongsanon et al. 2013


Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato. 2013. DeforMe: projection-based visualization of deformable surfaces using invisible textures. In SIGGRAPH Asia 2013 Emerging Technologies (SA ’13). ACM, New York, NY, USA, Article 8, 3 pages. DOI:

Project Page

Leave a Reply

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s