We spent a week embedded with Microsoft’s Mixed Reality Capture Studios in Redmond alongside Dimension Studios.

Microsoft’s volumetric capture technology records human performances as volumetric video (or holograms) for use in virtual, augmented and mixed reality experiences.

Performances are captured within a circular array of 106 RGB-infrared cameras, which simultaneously record colour and depth data. Computer vision algorithms then reconstruct a textured 3D mesh for every frame, producing a high-resolution, low-latency MP4 that can be played across multiple platforms as volumetric video.

The results are remarkably lifelike and highlight the exciting potential of volumetric capture for the future of immersive entertainment. It was fascinating to gain a behind-the-scenes look at the technology and processes Microsoft uses to bring virtual humans to life. A big thank you to the MRCS team for such an insightful and inspiring visit.