state.scape: EEG-based Responsive Art Installation
State.scape: Using EEG-based brain-computer interfaces for a responsive art installation
State.scape is an interactive installation in which audio-visuals are generated from users affective states (engagement, excitement, and meditation). The installation relies on a brain-computer interface based virtual environment and sonification, which both served as a platform for the exploration of users’ affective states in a responsive art installation
Studies on electroencephalography (EEG) based brain– computer interfaces (BCI) in the past have focused mostly on real time task processing such as using brainwaves for moving an object on the screen but more recently, there has also been a push towards using BCI for tracking emotional states or intentions.
To what degree users are aware of their influence on the system?
A virtual environment in Unity3D in form of an art installation incorporating an EEG-based brain computer interface (BCI) is placed in a dark room, with a video projection displaying a computer-animated flock of birds.
Simulation parameters (e.g., number of birds, flying speed and motion type, as well as ambient soundscape) either directly corresponded to the user’s current state assessed in real-time either by an Emotiv Epoc EEG headset (experimental condition) or were randomly generated (as a control condition).
The results corroborate the potential of BCI-supported interactive immersive environments. Even though the participants didn’t know which emotional state was mapped to which simulation parameter, the results demonstrate that participants were in most cases able to recognize the patterns of changes in the simulation and relate those to their inner feelings at that moment. This, in turn, directly affected their degree of immersion in the environment.
Prpa, M., Riecke, B. E., & Miucin, S. (2015). State.scape: a brain as an experience generator (pp. 1–4). Presented at the ISEA 21st
International Symposium on Electronic Art, Vancouver, BC, Canada. (Download)
Prpa, M., Miucin, S., & Riecke, B. E. (2014). Towards User Personalized Environments: an Artistic Exploration Using an EEG-Based Brain-Computer Interface,. Poster presented at the Academy of Neuroscience for Architecture (ANFA) Conference, La Jolla, CA, USA.
Prpa, M., Miucin, S., & Riecke, B. E. (2014). Using an EEG-based brain-computer interfaces for a responsive art installation
. Poster presented at the ACM Symposium on Computational Aesthetics (CAe), Vancouver, Canada. Retrieved from http://expressive2014.mpi-inf.mpg.de/