Fish-brain-machine / Radiona workshop

After constructing the Fish-brain-machine PCB circuits we spent some time experimenting and describing the hallucinogenic visuals created by the stroboscopic light. The ping pong balls over the eyes diffuse the LED light, making for a more intense effect – and enabling use with eyes open. Here they describe some of the effects including seeing colours and ‘a strange experience’ of seeing with only one eye – I get this exact same feeling when using it. It is also hard to know if your eyes are open or closed. [See also Re-mapping the senses workshop ]



Face as Interface

Trying to create a simple motion tracking patch using PD_extended and Gem, I came across this project by Elektro Moon Vision the mini App provides OSC data from movements such as eyebrows, nose, mouth, orientation scale etc. This is massively useful for an experiment I have in mind related to the “strange face in the mirror illusion” The data can be captured and used to control a 3D model in virtual space for example. Matching rotation, scale and orientation to the model and the movement of my head…

This is a simple motion detection patch that tracks the difference between two frames creating ghostly outlines of momentarily disembodied features. Its sensitive enough to pick up facial expressions such as the movement of muscles and eyeballs. A combination of these two systems should be enough to develop a system of projecting on to a face and follow its movements.

Screen Shot 2018-01-19 at 12.50.44.png
In this video still, the tracking detects the movement of my left side of the face as I smile on one side, to see if it detects the movement of my mouth as well as cheek muscles. the Red circle detects the centre of mass of the image 


Screen Shot 2018-01-19 at 12.49.53
Sensing motion by measuring differences in live video frames Using Pure Data and GEM


See here for the experiments with the strange face in the mirror illusion so far…