Virtual Reality Music Visualization


Under the name “Echobit,” Brian Hansen and I have been performing immersive VJ sets and audio-visual experiments using the Oculus Rift. We apply audio feature extraction and MIR techniques in order to create rich, interactive visuals. Users are able to explore visual worlds while they react to musical material in real time. The visuals are also projected on the wall so that all audience members can all take part in the experience.

I believe it’s the first application of Virtual Reality technology as applied to VJing and music visualization in general.

It is built in OpenFrameworks using a custom system for generating audio-reactive geometry and GLSL shaders.






  • Thorsten
    July 18, 2016 - 11:14 pm | Permalink

    Nice work! Any Videos of the footage from inside the Headsets?

    • admin
      July 19, 2016 - 10:32 pm | Permalink

      Not yet, but I do have a video that I took on my phone from the second show:

      We’re working on ways to do screen captures- it’s annoyingly difficult to pull it off with the audio/video synced and decent quality. I’ll get a better one next round though. Thanks for the interest!

      • Thorsten
        July 21, 2016 - 12:03 pm | Permalink

        Wow, I can only imagine what this must be like from inside the Rift.

  • Leave a Reply

    Your email address will not be published. Required fields are marked *