Augmented Reality for Film Production

Augmented Reality has moved from a novelty to a production infrastructure tool across the film and video industry. From pre-production visualization to real-time on-set supervision, AR is collapsing the gap between what a director imagines and what a crew can execute—often in the same physical space, in real time.

Pre-Visualization and Virtual Scouting

Traditionally, pre-visualization (previs) required either expensive physical mockups or context-free 2D animatics viewed on a flat monitor. AR headsets—including the Apple Vision Pro and Microsoft HoloLens 2—have made it possible to walk through a scene anchored in real physical space before a single light is rigged. Directors can place virtual cameras inside a real location, adjust lens choices, and share spatial compositions with their director of photography without committing to a build. Companies like The Third Floor, whose previs credits include Avatar: The Way of Water and the Avengers films, have integrated AR review workflows so studio executives and filmmakers can approve sequences spatially rather than on a flat screen. Virtual location scouting tools built on photogrammetry—like those developed by Matterport and its integrations with Unreal Engine—let production designers attach dimensional AR overlays to scanned real-world locations, annotating set extensions, lighting positions, and camera sight lines directly in space.

Virtual Production and LED Volume Stages

The most technically significant convergence of AR and film production is the LED volume stage, popularized by Industrial Light & Magic's StageCraft system used on The Mandalorian and its successors. In these environments, actors perform in front of massive curved LED walls displaying real-time rendered environments driven by Epic Games' Unreal Engine. AR plays a critical role in what the camera actually captures: camera tracking systems from companies like Mo-Sys and Ncam feed real-time lens position data into the render engine so that the virtual background exhibits correct parallax as the camera moves—creating a seamless AR composite in-camera rather than in post. The director of photography sees a live, correctly matched environment through the viewfinder, not a green screen. By early 2026, LED volume stages from vendors including Lux Machina, Pixomondo, and disguise (formerly d3 Technologies) have become standard infrastructure for major streaming productions, reducing location costs and enabling weather- and geography-independent shooting.

On-Set VFX Supervision and Real-Time Compositing

Before LED volumes, VFX supervisors working against green screens relied on experience and imagination to confirm that practical elements—lighting, actor positioning, shadow angles—would integrate believably with digital backgrounds added months later. AR tools now allow supervisors to view a live AR composite on-set using calibrated tablets or headsets, checking in real time whether a performer's shadow contradicts the virtual sun direction or whether a practical prop clips a digital architecture element. Ncam's AR system, used extensively on productions at Warner Bros. and Netflix, projects virtual set elements directly into the monitor feed during shooting, enabling directors and VFX supervisors to catch integration errors before they become expensive post-production problems. Real-time compositing software from Disguise and Brainstorm Multimedia extends this capability to broadcast and live event production, where there is no post phase at all.

AR-Assisted Camera, Lighting, and Continuity Workflows

Smart glasses and lightweight AR overlays are beginning to address long-standing inefficiencies in physical production logistics. Script supervisors—responsible for continuity across shooting days—have piloted AR wearables that overlay reference frames from previous shots directly into their field of view during a take, flagging potential continuity violations in real time rather than after the fact during editing. Cinematographers are using AR lens visualization tools to overlay projected focal length field-of-view guides and depth-of-field planes in physical space during blocking, without touching the camera. Gaffer teams are experimenting with AR lighting diagrams anchored to physical set geometry, so the intended lighting plan floats visibly above the actual floor rather than being interpreted off a 2D plot. Canon and ARRI have both filed patents in recent years for AR-integrated viewfinder systems that would embed live metadata overlays—focus distance, exposure, lens distortion data—directly in the optical path.

The Smart Glasses Era and What It Means for Production

The 2025 explosion of Meta's Ray-Ban smart glasses—7 million units sold, with production scaling toward 10–30 million units in 2026—opens a new distribution layer for AR on set. Unlike dedicated industrial headsets, consumer smart glasses are socially unobtrusive and wearable throughout a full shooting day. Productions are beginning to evaluate them for hands-free access to call sheets, shot lists, and real-time communication with remote VFX facilities. Meta's AI-powered scene understanding features, which allow the glasses to interpret and narrate physical environments, have obvious applications for accessibility on set and for real-time script continuity checks. As the form factor matures toward full spatial displays—anticipated in Meta's next-generation hardware—the distinction between a director's monitor, a VFX supervisor's composite review tool, and a smart glasses AR overlay will begin to collapse into a single, persistent, spatially-anchored production interface.