Art and neuroscience: when the brain meets creativity
From the first experiments in neuroaesthetics to installations that turn brain activity into images and sounds, the dialogue between science and art is opening up new possibilities for expression.

The meeting of art and neuroscience is opening up new expressive possibilities. Research provides tools to observe brain activity, while creativity makes it possible to turn the data collected into images, sounds and experiences.
A night in Toronto, between art and brain activity
Toronto, 5 October 2013. During the Nuit Blanche art festival, a group of people put on special sensors and take their place inside a large immersive environment. Around them, digital images and soundscapes transform according to the signals recorded from their brain activity.
The installation is called My Virtual Dream. It is the result of a collaboration between researchers, artists and developers, created to explore the possibilities of interaction between the human brain and digital environments. Over the course of the night, usable EEG data are collected from 523 participants, engaged in concentration and relaxation tasks through a neurofeedback system.
The experiment, later documented in a scientific study, shows how brain signals can become part of a collective artistic experience. Participants interact with an audiovisual space that responds to the processing of their brain activity.
It is a meeting of research and creativity that raises a fascinating question: how far can the workings of our brain enter the process of making art?
Science meets aesthetic experience
The relationship between the brain and art has been studied for several decades. One of the most interesting fields is neuroaesthetics, the discipline that investigates the neural processes involved in aesthetic perception and judgement.
Looking at an artwork involves many brain functions. Colours, shapes and compositions are processed by the visual systems, while memory, attention and emotional processes help build the overall experience.
In 2012, a study led by Edward Vessel, Gabrielle Starr and Nava Rubin at New York University made a significant contribution to this field. Using functional magnetic resonance imaging, the researchers observed the brain activity of people evaluating artistic images.
The artworks that participants found most moving were associated with greater activation of certain regions belonging to the default mode network, a brain network also involved in personal reflection and self-referential thought.
The results suggest a link between particularly intense aesthetic experiences and the processes through which we handle information about ourselves.
Research in neuroaesthetics continues to explore these relationships, building an ever richer understanding of how the brain takes part in the experience of art.
From brainwaves to images
Alongside studies on the perception of art, another line of experimentation has developed: using brain activity as part of a creative process.
Electroencephalography, or EEG, uses electrodes to record changes in the electrical activity generated by populations of neurons. The signals collected contain oscillations that can be analysed in different frequency bands, commonly called delta, theta, alpha, beta and gamma.
When EEG signals are connected to a digital system, some of their properties can become parameters that shape images, animations, sound compositions and light installations. For example, an algorithm can link changes in a given frequency band to the movement of a shape, the transformation of a visual structure or the intensity of a light effect.
Brain activity thus becomes a component of artistic language, through a processing system that translates measurable data into expressive elements.
How to represent those signals is a choice that belongs to the creative project: it is precisely where scientific measurement meets artistic interpretation that these experiments take shape.
An installation shaped by the mind
In 2018, at the National Taiwan Museum of Fine Arts, the artists Betty Sargeant and Justin Dwyer of the PluginHUMAN collective presented DREAM 2.2, an immersive installation built around this possibility.
The environment combines digital projections and sound compositions that respond to the brain signals of the performers and the audience, captured through EEG devices. Participants can watch the work transform as the system processes their brain activity. Images change, sounds are triggered and the environment takes on different configurations.
The technology creates a special relationship between what happens inside the body and what takes shape in the surrounding space, making visible, through an artistic interpretation, a set of physiological phenomena that are normally imperceptible.
Data generated by the body and the artists' creative choices come together in a single experience, in which science, technology and visual language are in constant dialogue.
FormaMentis and creating art through brain activity
The dialogue between neuroscience and creativity finds its own interpretation in FormaMentis, a project that uses EEG signals and digital generation systems to create personalised visual artworks.
During a short guided session, a non-invasive EEG device records some signals of the participant's brain activity. The data are processed and turned into parameters that help define the shapes, colours and composition of the image.
Brain activity thus becomes part of the creative process, giving life to an original artwork that the participant can keep and share in digital form.
In museums, FormaMentis offers an experience that brings together scientific knowledge, artistic expression and personal participation.
For museums, the dialogue between art and neuroscience is an opportunity to explore new languages and to bring the public closer to scientific knowledge through art.
The future of this dialogue is built through new possibilities of expression, where technology, research and artistic sensibility influence one another.
FormaMentis explores the meeting of neuroscience, technology and creativity through personalised artistic experiences. Discover the project at formamentisart.com.
Sources and further reading
- Vessel, Starr and Rubin (2012), The brain on art: intense aesthetic experience activates the default mode network.
- Kovacevic et al. (2015), My Virtual Dream: Collective Neurofeedback in an Immersive Art Environment.
- PluginHUMAN (2018), DREAM 2.2 — An Interactive Art Experience Controlled by Brainwaves.
