Face as Interface

Trying to create a simple motion tracking patch using PD_extended and Gem, I came across this project by Elektro Moon Vision http://elektromoon.co.nr/ the mini App provides OSC data from movements such as eyebrows, nose, mouth, orientation scale etc. This is massively useful for an experiment I have in mind related to the “strange face in the mirror illusion” The data can be captured and used to control a 3D model in virtual space for example. Matching rotation, scale and orientation to the model and the movement of my head…

This is a simple motion detection patch that tracks the difference between two frames creating ghostly outlines of momentarily disembodied features. Its sensitive enough to pick up facial expressions such as the movement of muscles and eyeballs. A combination of these two systems should be enough to develop a system of projecting on to a face and follow its movements.

Screen Shot 2018-01-19 at 12.50.44.png
In this video still, the tracking detects the movement of my left side of the face as I smile on one side, to see if it detects the movement of my mouth as well as cheek muscles. the Red circle detects the centre of mass of the image 

 

Screen Shot 2018-01-19 at 12.49.53
Sensing motion by measuring differences in live video frames Using Pure Data and GEM

 

See here for the experiments with the strange face in the mirror illusion so far…

Advertisements

Author: Antony Hall

I create kinetic artworks; sculptures and installations, often using sonic, mechanical, fluidic, electronic or biological elements. I am also a founding member of artist collective Owl Project [www.owlproject.com] PhD researcher, amateur scientist, Cyclist

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

w

Connecting to %s