The artwork is the result of a collaboration between the brains that create some of the coolest looking synthesisers and music hardware, and design studios Modemand Bureau Cool.
Researchers have now created an AI that forms a kaleidoscope-like artwork based on music composition created on Teenage Engineering’s OP-Z sequencer.
Modem
The artwork is the result of a collaboration between the brains that create some of the coolest looking synthesisers and music hardware, and design studios Modemand Bureau Cool. The entire project is essentially an inspiration from a neurological condition dubbed synesthesia.
To the unaware, this phenomenon causes the brain to experience sensory input from several senses instead of just one. For instance, a listener experiencing this condition could see music instead of hearing it, observing it via mediums such as colours, movement and shape with response to musical patterns.
In the current experiment, TE’s OP-Z sequencer acts as a music source which gets translated into AI art. The digital extension created by Modem and Bureau Cool translates musical properties into text prompts, describing different colour shades, shapes and the way they move.
These prompts then go through Stable Diffusion -- an open-source tool just like DALL-E and Midjourney to create mesmerising synesthetic animations.
Modem co-founder Bas van de Poel calls this experiment the fuel for the imaginations of the artists out there. He said in a statement to Engadget, “With the project, we see the potential for musicians to explore new forms of creativity, facilitating a joint performance between human and machine.”
Watch the AI in action below.
