I would like to explore the use of biometric feedback as an artistic process. Through the use of a participant’s own body as an instrument for which a piece is performed, a heightened level of intimacy can be achieved. This process becomes more inspiring when the biometric data is fed back to the participant in the form of generative audio and video. Through this feedback loop, the participant’s involuntarily responses becomes a contributor to the artistic process. The result is created from an extension of the participant, from their body. To explore this new form of an artistic process, I propose to create a bio-metric performance and software environment, an environment that can bring artistic interaction to a new level, allowing participants to learn from, grow with, and change the course of the composition.
Within the performance environment, 360 degrees of multichannel video and audio will surround the participants, allowing them move around freely. Each participant will wear a standardized, lightweight bio-metric transmitter containing a head and wristband.
The Recombinant Media Labs 360 degree projection environment.
The device is no bigger than a Nintendo Wii controller and connects to the head and wrist band by a small cable. Inside the wrist band are sensors to detect the user’s Galvanic Skin Response (GSR) , blood pressure and heart rate, while the headband contains two Electroencephalography (EEG) sensors. The controller houses a battery case housing and Arduino with an XBee shield for wireless transmission.
The bio-metric unit will transmit the users data from the sensors to a host computer. Through a custom software environment, the host computer will both generate and modulate both audio and video sources based upon the participant’s incoming bio-metric data. When a participant’s bio-metric data lies within a specific range a mood-like state will be applied. States will be then be used to apply variables such as attraction, repulsion, orbit and buoyancy to encourage participants to interact with each other.
In order to yield an emotive result from this technical environment a unique composition system will also be developed. This environment will allow composition to occur on a multi-track and multi-channel time line as well as the ability to map phrases, chords, and timbers to each state. The resulting performance will comprise of a symphony written by the composer but performed by participant’s own bodily response.
In addition to the performance environment an online database will be constructed to for each user to tag and upload their collected biometric data. The user can then compare data sets by categories such as activities, variance and body type.
Luciana Haill measures Brian Barrit’s EEG using the IBVA in Liverpool’s Fact Gallery
