facebook pixel
In collaboration with @MontereyBayAquarium we built a generative music experiment where moon jellies controlled music made by Lyria 3, serving as the opening act at Google I/O! The jellies were live streamed from their home at the Monterey Bay Aquarium. They were then tracked by a lightweight object detection model, running on Google’s tiny, low powered Coral NPU housed on a Synaptics Coralboard. The Coralboard sent the jellies’ coordinates to our music generation engine. Each quadrant of the screen represented an instrument: drums, bass, chords or melody. The number of jellies in each quadrant determined the weighting of the Lyria 3 Pro generated music. While it was technology that translated the jellies' movement into sound, the real magic came from the animals themselves. #Lyria3 #GoogleIO #GoogleGemini

 14.5k

 438

 21

 14.5k

    Suggested Credits
    Tags, Events, and Projects