Assignment due the night before our next class:

• [x] CREATE/EXPLORE • Create an audio experience using sound synthesis. Create a blog post documenting your work.
• [x] Submit links to post and sketches in this form.

HandPose Synth

https://editor.p5js.org/jz2450/sketches/Dxx-oMWVc

I wanted to explore the controller of a synth rather than going in depth into playing around with actual computational sound synthesis. Using a simple PolySynth built into p5 sound, I took the video feed, sent it through ml5 and got back the approximate positions of my fingertips. Using the coordinates I triggered a selection of notes, with each row a harmonic 5th up above the row below.

Ran into some issues with PolySynth not being able to render some sounds and overloading with longer notes and if the fingers fluctuated too quickly. A good next step would be figuring out a way to sustain the notes and also a dynamic control.