Image Filter with Teachable Machine

For this sketch, I was motivated by my constant swaying back and forth when I am on a Zoom call. I thought about how my camera could react to this movement and help me be aware and present regarding my body's movement in front of the computer.

I did a quick test of how Teachable Machine can be use to create interactive filters in P5js that respond to body movement. For this version, I used images to train Teachable Machine on detecting head tilts to the right and left.

This was a great exercise to start thinking about the necessary states to make Teachable Machine "smarter". I did not generate a condition for when the screen is empty so when no one is on the picture the filter just randomly tries to decided whether it tilts left or right.

I found Teachable Machine to be a great tool for beginners want to learn about AI and machine learning. Training the dataset is very straightforward and accessible for someone with little coding background. In a future version, I would like to use body poses instead of images to see what its affordances are for smaller body movements like head tilts.

Live sketch

‍

Demo video

Link: https://editor.p5js.org/ThaisAlvarengaMedina/sketches/Wm_3hMeaY