James McAlister
First of all, I super appreciate you being up for exploring this project and how we can integrate interactivity into some form of music video / live set.
Here’s a couple thoughts...
Music video ideas / examples
I think we should create the music video and the live set to be a part of the same world. The interactive elements of the live show (triggered by audio, midi etc) can also be the elements that are affected in the music video. For example, we could extract the midi data from stems and/or us the different stems to drive different elements.
Live set interaction
Creating an interactive system that controls video playback [ live cameras too ], with audio interactive elements — We can also use midi as triggers etc.. This is can be flexible with how you perform live and your workflow.
Audio + Midi + Camera in
V
[ Generative system ]
V
Video Out
Examples: FX and video playback controlled by audio frequencies
Not in this style...but gives you an idea of interaction.
Interactive gallery setting
For the gallery space idea, we can create multiple ways of people to interact with your music and the space itself.
Audience interaction?
Physical buttons / playback.
We could create an interactive system that allows for people to change the audio and visuals in real time...think midi control but using different inputs. A simplified example of this [ below ] is our capacitive gallery space. We used capacitive touch sensors to allow people to touch the window externally to control the lights and audio in the space. This could look like a stem / loop playback system that the audience controls.
A live version of the music video
We could use the same interactive setup we used for the music video, but integrate live cameras within the gallery space, letting people become apart of the music video.
Audio generative posters
I recently did a project for a local gallery, we had an interactive booth where their audience would answer some questions about their experience. Depending on how they answers [ type slow or fast / amount of text ] it would generate an art poster which is completely unique to them. This is something we could also include any of this ideas...whether it’s something that gets printed on site, or is emailed to them. It could be generated using the audio or cameras of something else in the space.
I’ve also included an example of a poster that is generated in real time using live audio.
Interactive audio visual gallery
Generative artwork
Audio Generative poster