Fish-brain-machine / Radiona workshop

After constructing the Fish-brain-machine PCB circuits we spent some time experimenting and describing the hallucinogenic visuals created by the stroboscopic light. The ping pong balls over the eyes diffuse the LED light, making for a more intense effect – and enabling use with eyes open. Here they describe some of the effects including seeing colours and ‘a strange experience’ of seeing with only one eye – I get this exact same feeling when using it. It is also hard to know if your eyes are open or closed. [See also Re-mapping the senses workshop ]

IMG_2058.JPG

Advertisements

Spontaneous sensations

Here are the outcomes from a simple experiment, superimposed from 8 participants. The experiment is described in the paper “the tickly homunculus and the origins of spontaneous sensations arising on the hands”  in which you focus on your hand while staring at it (convergent focusing) or divergent focusing (staring at red marker next to the hand you are focussing on) for just 10 seconds and report the sensations…

IMG_2184 (1)
In this experiment, many of the bemused participants described a tingling where the hand made contact with the table. They were bemused because I did this experiment in the context of our methods and methodologies discussion group – where I was attempting to present my project. I thought it would be interesting to experience, ‘first hand’ the type of phenomenological experiments I’m looking at, and ‘practising’…

https://www.ncbi.nlm.nih.gov/pubmed/21190869

Radiona workshop, Zagreb

I’m doing a workshop related to my research, perceptual illusions and altering perception through experiments, Clay hand illusion and other activities based on sound and light and taste, at Radiona Zagreb, 21-22/04/2018 https://radiona.org/ check out the web Re-mapping the senses workshop page and resources here…

micro_research04

Enki PCB

IMG_1847
Fish-Brain-Machine circuit
The Fish-Brain-Machine circuit represents biology of an electro-genic fish known as the Black Ghost Knife Fish. These fish navigate with electrical fields generated from within their bodies. Their skin is used as a receptor to see the world around them.

art-works73
The Enki project used the electrical signals from these fish to control stroboscopic flashing lights that create hallucinogenic visual patterns, that in turn affect our brain states*. Sweat sensors send a signal back to the fish, creating an interconnected loop of biofeedback between the human and fish.

This Fish-Brain-Machine circuit senses sweat levels on your fingertips to control the stroboscopic LEDs. Place this over the eyes, sit back and experience hallucinogenic visuals. The Circuit represents the Enki project in miniature and was designed in collaboration with Marc Dusseiller as part of the Enki exhibition Kapellica Gallery, Ljubljana, SloveniaLink to Enki Project 2012…
See the original Post…

Chip spec :
CMOS Quad-NAND gate

Capacitor 470nJ = 0.47 uF at 63V

2 – 8 MOhm Resistor

2 bright LED’s

Battery Clip (either 9V clip – very bright, or 2 holders for 3V coin batteries)

Fish2BrainHack_simulator_v2

Fish-brain-machine

enki_interface_circuit

As part of my Enki exhibition at Kapellica Gallery in Ljubljana 2012, I developed a related perceptual illusions and brain hacks workshop with Marc Dusseiller [Hackteria], as part of the gallery’s Biotech program. We came up with the idea to make a special issue circuit for the workshop and we set to work designing a circuit the encapsulated the Enki project in miniature.

Fish2BrainHack_simulator_v2

After a couple late nights, we came up with this super cool PCB design. Marc worked hard to create a fully functional efficient design, which was also aesthetically pleasing. The outline of the fish is also the ground in the circuit. This has to be the most ultra minimal brain-machine available to build. 6 components. We spent further late nights acid etching the circuits for the workshop in Marc’s home lab.

enki-circuit02

It uses ‘biofeedback’ to control the pulse frequency of the lights, low tech Galvanic skin response. Your fingertips press on the fingerprint, acting like a simple resistance meter, sensing the sweat levels to control strobe frequency [specifically 10-30htz to create hallucinations] of two ultra-bright LEDs to create the optical stimulation. The capacitor and resistor set the standby slow pulse and the range within the level necessary to cause visual hallucination. The design incorporates measurement graduations for eye spacing so you can personalise LED placement to fit your eyes.

It’s possible to use extra LEDs and several colours.  After soldering the 6 components its possible to layback and experience your own personal electronic psychedelic experience.

Fish brain interface DIY PCB
Marc Dusseler Fish brain interface DIY PCB

Strange face illusion with two-way Mirror feedback

 

A version of the Strange Face illusion with video feedback and face tracking through a two-way mirror

“… a quiet room dimly lit by a 25 W incandescent light. The lamp was placed on the floor behind the observer so that it was not visible either directly or in the mirror. A relatively large mirror (0.5 m60.5 m) was placed about 0.4 m in front of the observer. The luminance of the reflected face image within the mirror was about 0.2 cd mÿ2 and this level allowed detailed perception of fine face traits but attenuated colour perception…The task of the observer was to gaze at his/her reflected face within the mirror. Usually, after less than a minute, the observer began to perceive the strange-face illusion…”  Giovanni B Caputo, Perception, 2010, volume 39, pages 1007 – 1008 2010

 

Mechanically Augmented Reality

When I first learned about the Rubber hand illusion [RHI] I immediately began to think about ways in which the process could be automated to create an artwork, in which the experimenter’s presence was removed. This could be done using sensors and a microcontroller to articulate solenoids to tap fingers for example. That thought train was on a back burner until discovered the work of fellow MMU PGR Lin Charlston. As part of her PhD research [See her profile here ‘The Multimodal book as organism, artefact and assemblage: non-human agency in processes of growing and making’] She invented a beautifully simple, entirely mechanical device just to do exactly this.

Drawing of Lin Charlstons device ‘Meshy’

Your hand is placed inside a box, while the other hand turns a crank. On top of the box, another rubber hand is placed. This is where Lin’s experiment takes on its own twist; on top of the rubber hand is a piece of moss. Fixating on this, and turning the crank, a copper disk rotates.  A delicate metal bead curtain brushes over the moss, and over the fingers of the false hand. Simultaneously the hidden real hand receives the same treatment. If the illusion works for you, ownership begins to drift from your real hand to the fake hand. Specifically, the moss begins to feel like it is part of your own hand. [if you are not familiar with the Rubber Hand Illusion check this post]

 

Although Lin has not settled on a name for the device yet, I couldn’t help trying to think of what one might call such a device and came up with the term ‘Propriosope’ [or Propioscope as I noted] a device for shifting bodily ownership from a body to another body or object [see my post on Unfeaseable objects here…] One could imagine autonomous devices made based on any number of experiments related to the RHI [See my post on Illusions of Invisible, alien hands, 3 arms, and shrinking bodies ]

Experiments with cranks

 

This has made me reflect on the use of the crank as a convenient mechanism of ‘interaction’. For example; In the RHI synchronous tapping and stroking is essential to generate the illusion. A direct and tangible relationship between what is seen and felt.

Its difficult for the experimenter to replicate this manually, thus a system that can deliver this automatically could useful. It could also be useful in terms of ‘Augmented Virtuality’ interacting with real-world objects in virtual space.
The crank ensures the participant has their hands arm and body in a certain position. And they probably know how to operate the crank intuitively. img_1811                    

The above sketch shows an idea for an experiment: A version of Lin Charlstons device scaled up to resemble a version of body swap illusion [ Henrik Ehrsson and Olaf Blanke http://www.eurekalert.org/pub_releases/2007-08/ucl-foe081407.php]. In which a VR headset was linked to a live camera feed whereby the participant can view their own body, but from a few meters behind themselves. The experimenter taps their back with a stick. In this crank operated version:

  • A person turns a crank.
  • In front of them is a box with an eyepiece into which they look.
  • As they turn the crank, an articulated human model inside the box also turns a crank in synchronisation.
  • The crank turns a ball on a post gently taps both model and participant on the back.

We could try the same arrangement as a physical model, a virtual model viewed in VR. Or linked video, in which the playback is synced exactly with the movement of the crank. How powerful would the effect be? What other Stimuli could be incorporated instead of a tapping ball.

I have experienced something similar in action through an artwork by painter Iain Nicholls and creative technologist Tom Szirtes. ‘Veil’ is a virtual reality work that references early filmmaking, fairgrounds, and the paintings of Velazquez, David Fredrick and Holbein.  The site-specific installation includes a cardboard model house sitting on a plinth and a virtual reality headset which the visitor is invited to wear.

But there is a handle to turn as well, therefore, I would say this verges on Augmented virtuality. I found it to be a powerful effect. I will be writing about this installation and others for the next post…

https://www.imperica.com/en/in-conversation-with/in-conversation-with-iain-nicholls-and-tom-szirtes