Hi Senterio...
Thanks for your answer... !
Everything in our work responding with the music.
For exemple, if you take the hand drawn animation, you can see that there is some "bugs" interacting with the music, such as blur, shake, transitions... and everything is played like a music partition.
If you take the other video, named "chkrrr - islandia" (you can change video below the player
here), you will see that there is a lot of things that react with the music. And more, the "speaking guy" is just a sample, working on the sound that we capture in a sound table, so we can juste use the bass, the middle, or the treble to make him speak...
The 40h Monome is a controller (OSC, Midi and whatever you want !) for audio (for exemple with Max/MSP). But you can do whatever you want with it. It's simply a pad with 64 buttons, that can be toggles, press buttons or fader, or timeline, or sampler... etc... you will be able to find more informations here :
http://monome.org
The module we are working on is to make easier the use of the controller with modul8, by integrating for exemple, the midi out...
Cheers !