projection mapping onto moving objects


Projecting onto 3d surfaces

I have been thinking about different ways of projecting onto physical objects, my concept at the moment involves projecting onto physical puppets infront of rear projected environments. The technical method of making this system work could use infra red computer vision or electronic sensors in the puppets or a combination of both.

This video by Johnny Lee shows a method of using light sensors to map a projection onto a 3d surface.

The only problem with Johnny’s system is that it can’t be used with moving objects.


Research for project proposal

The conclusion of my essay was to create an experimental cinematic experience using physical elements. Originally I planned on focussing on methods in which imagery is captured, however the experience would still be constrained by a rectangular screen. Doug directed me to the artist Tony Oursler who experiments with projecting onto different surfaces.

Tony Oursler

This image shows how Tony films real eyes and projects them onto surfaces in a physical space. This idea of reconnecting objects with a physical space will be the focus of my next research.


Three concepts

For my project I am starting with the topic extended consciousness with Interaction Design as the production method. The three concepts are also related in the way that they compare the emotions associated with physical and digital mediums.

The first concept is to probe the empathy people hold for computer generated visual communication compared with that of traditional physical mediums. Aspects of this concept are associated with the uncanny valley theory, the realism in artificial human faces get to a point where they they look creepy. Why is there not a similar problem with oil painting?

The second concept is an examination of happy accidents, a unexpected result in physical arts that is beneficial. Does the logical computation of imagery reduce the chance of unplanned results? An example of a happy accident is in Holga film cameras, they are not perfectly light tight and produce unique pictures when the film is exposed. Film camera do not give an undo option and a fair amount of mastery is required to get it right the first time.

The third concept is a study of the value given to digital art considering there is no original copy and infinite copies can be made. If a physical created illustration is viewed digitally, does it hold higher value than one created with software? Does the value given to digital and analogue art come from universal considerations such as composition, technique and energy?




Body Language

One idea I have for making interactive clothing is have several mercury tilt switches in the arm to act as an angle sensor.

arm sensor

Each tilt sensor is at a slightly different angle to detect if in arm is swinging, resting or holding an object.

This information can represented by two animated creatures that play, sleep or work according to the corresponding arm.
arm critter

I haven’t decided on whether the display would be separate or integrated into the clothing.

pocket puppet


The Light Fantastic

For this project, I am making an item of clothing or something that can be worn that lights up. The final object needs to be portable and cannot be plugged into a wall socket.

el wire

The Daft Punk light suits led me to look into Electroluminescent wire (EL wire). Connecting EL wire to an arduino requires an inverter to convert DC to AC, so it will more difficult than LEDs but the wider light area will be worth the trouble.

low poly mask

This low polygon mask by Eric Testroete and other wire frame models have inspired me to create a mask in the shape of a simple geometric human head.
low poly head

The mask will be made from flat planes of diffusing material, perhaps some sort of plastic film. El wire inside the mask will cause the head to light up uniformly. The EL wire could be triggered by sound or switches mounted beneath the wearers shoes. Air circulation and visibility will have to be considered, possibly black mesh could cover the eyes and mouth.



I am researching the following items of wearable technology:

nintendo power glove
Nintendo Power glove

daft punk light suit
Daft punk light suits

LED hoodie bomb scare

LED hoodie bomb scare


Wearable Technology



In the development process to create a live performance, I have taken a strong visual style influenced by retro video synthesizers, paper rad, tim and eric awesome show, wonder showzen and jimmy joe roche. These visuals can contain cartoons, intense flashing, primative 3d and bright colours verging on being painful for eyes to watch. The main goal is to create an intense experience in an imaginative virtual space in real time.  There will also need be a virtual camera to explore the virtual space this would move pan and zoom to experience the perspective of being immersed within the environment.


Examples of the scanimate video synthesizer

tim and eric

Tim and Eric use modern techniques to replicate the old video synthesizers.
paper rad

paper rads flashing images should come with a warning, jimmy joe roche using a diamond transition

An improvised performance will take place between virtual performers and a virtual camera. There will also need be an improvised performance between elements controlled within the environment and a virtual camera. To optimize the improvised possibilities there will need to be freedom in every possible aspect of the virtual performers. A Midi controller will be used to interface with interactive elements in the environment and could also be used to create audio. A game controller would be perfect for manipulating the virtual camera because it will help to make the movements of the camera more mastered.


« Previous entries