Gesture Music
Art Instillation | P5.Js | Touch OSC | Chat GPT
Project Overview
Gesture music is a project to incorporate controlling music and gestures, using ChatGPT to help exploration, terminal, P5.js, and TouchOSC. Multiple fellow designers developed this project but ultimately had a unique touch from my interests.
Prompt
Create an experience that incorporates Image/Video, Audio, Shapes/Particles, and Gestural activities as the control system, but use ChatGPT to gain/explore what we might not have been able to figure out ourselves in coding.
Press the button in the center to change the particles from dots to concentric squares.
Control the experience though holding your phone
Flick upward to change the color of the particles and circle. This is changed through a change in speed when handling the phone.
Turn the phone to change track and visuals. Turning to the right will skip one forward, and turning to the left will skip one back.
Starting with the basics. Who, what and why.
Using constant iterations of code, and ChatGPT we were able to create a project that was functional and delivered the vision. I found an old Super 8 film of surfers on YouTube @SurfingVisions and picked 5 songs that I wanted to accompany them. Songs: The Doors - Soul Kitchen, Jack Ducker - My Love, Manu Chao - Bongo Bong, Mac DeMarco - Freaking Out the Neighborhood, Pasiflorez - 1977 Space Board.
I used ChatGPT to smooth out the circle in response to sound
We used OSC data from our iPhone to get the gestures to work
What I learned
This process of learning Terminal, complex P5.js material, and stretching my coding knowledge has made me appreciate a tool like ChatGPT. The most valuable lesson I have learned from using ChatGPT is that the prompt you give will decide whether or not it will be valuable or not. While the project involved many collaborators in getting a foundation ready for the project, the exploration and learning experience that came from the project was valuable.