Paint With Music aims to make music accessible and fun for musicians and non-musicians alike. This experiment connects music with another major form of artistic expression: painting. Helped by Magenta’s DDSP library (Differentiable Digital Signal Processing), the drawings of the user are translated into musical notes, performed by a chosen instrument. People are invited to paint on sensorial canvases, such as the sky, or the ocean, amongst others. Read more here.
Role: Creative Director, leading a series of design thinking workshops between Google Arts and Culture team & Magenta AI Music. Working with the Google I/O Google on a new shape of the game inside the I/O Adventure platform. Year: 2021
Paint With Music
Transforming Painting Into An Accessible Music Instrument
Paint With Music - Second Life
We then worked with the Google I/O team to bring the Paint With Music tech to life in a different shape inside the Google I/O Adventure platform. Paint With Music became Musical Fishing - a real-time, social music game where I/O attendees can fish together and make music - each fishing row being a different musical instrument.
