Virtual Reality Music Visualization

13389153_10153545417151078_2109466568_o

Under the name “Echobit,” Brian Hansen and I have been performing immersive VJ sets and audio-visual experiments using the Oculus Rift. We apply audio feature extraction and MIR techniques in order to create rich, interactive visuals. Users are able to explore visual worlds while they react to musical material in real time. The visuals are also projected on the wall so that all audience members can all take part in the experience.

I believe it’s the first application of Virtual Reality technology as applied to VJing and music visualization in general.

It is built in OpenFrameworks using a custom system for generating audio-reactive geometry and GLSL shaders.

13405733_10153545417126078_329967991_o

13383837_10153545417091078_1576806256_o

13410685_10153545454681078_2133745267_o

13396857_10153545417206078_607676417_o

3 Comments

  • Thorsten
    July 18, 2016 - 11:14 pm | Permalink

    Nice work! Any Videos of the footage from inside the Headsets?

    • admin
      July 19, 2016 - 10:32 pm | Permalink

      Not yet, but I do have a video that I took on my phone from the second show:



      We’re working on ways to do screen captures- it’s annoyingly difficult to pull it off with the audio/video synced and decent quality. I’ll get a better one next round though. Thanks for the interest!

      • Thorsten
        July 21, 2016 - 12:03 pm | Permalink

        Wow, I can only imagine what this must be like from inside the Rift.

  • Leave a Reply

    Your email address will not be published. Required fields are marked *