19th-20th May, Microsoft Reactor, San Francisco CA
Emotions, music and VR are central to what we do at Melodrive. That’s why we’ve decided to organise #EmoJam, a weekend dedicated to hacking emotion, VR, games and music. We have envisaged a hackathon that addresses perhaps the most salient problem for interactive storytelling, AI, and VR: emotion. Emotion is a notorious puzzle for just about any field that deals with the mind/brain. It is clear that we have emotions to help us survive in the world. Without these, we would certainly be a different, although perhaps nonetheless intelligent machine. On the whole, it seems that we are not usually just interested in what intelligence is and how to model it, but we’re specifically interested in a particular brand of intelligence, namely human intelligence. And emotion plays a large part in that.
Ever wanted to do more with the music or SFX in your game? Maybe you want to go beyond triggering audio clips with basic effects towards infinite variations of explosions or gunfire? Maybe your player characters are robots and you want to vocode the player’s microphone input? Perhaps you want complete playable instruments within your game, or unique melodies composed for each user-generated character a la Spore?
If so, then using Pure Data (Pd for short) may be just what you need. Sure, you can do a lot of these things using FMOD and Wwise, but Pd makes the process so simple and elegant, and best of all: it’s free. If this sounds like your cup of tea, then read on!
This week, I had the opportunity to see a unique musical act in Mannheim, Germany. Specifically, the one-man show put together by up-and-coming jazz phenom, Jacob Collier. Jacob Collier, for those that don’t know, gained notoriety through his creation of multi-part YouTube videos for which he not only composes original and creative arrangements of classic songs, but also plays every instrument in the mix. His style is characterised by extensive use of vocal layering/a cappella arrangements, versatile and extensive re-harmonisations, polyrhythms and metric modulations, all rooted in jazz/funk style inspired by the hit composers of previous decades (Stevie Wonder, Herbie Hancock, Michael Jackson, the Beatles, etc.).