MXR, combines the unparalelled real-time 3D power of Unreal Engine with our own robust UI and custom integrations like PTZ controls and compositing pipeline. For Coachella this year we worked with YouTube, Google Cloud Platforms and Google Gemini teams to implement private genAI API calls enabling us to record content live with generative VFX. All shot, composited and generated in real-time. This marks a huge step forward for the integrated virual production tools we've been building into MXR.
MXR is quickly becoming a juggernaut of real-time VFX for events and broadcast as well as a genAI content creation one-stop shop. We used static 2D image generate from the cloud and off-line models for image processing i.e. background removal as well as synthetic data models to co-locate PTZ with stages to speed up the camera co-location and virtualization process. On top of that we demonstrated our own compositing pipeline for AR graphics, VISCA and FreeD integration, AJA Kona 5 integration, cluster rendering, lens distortion compensation and so many more features. All on location at the most prestigious festival in the world. We couldn't be prouder of the team for getting across the finish line in the desert heat and typical production timelines. Our dev and production teams deserve a metal. And some much needed time off. 🚀🎨🌟