Overview
ICVFX stands for In-Camera Visual Effects. It refers to a virtual production method where digital backgrounds and environments are displayed in real-time on large LED walls and captured directly by the camera along with the live actors and props. Unlike traditional greenscreen, the final image ("in-camera") is created on set, without post-production compositing for the background.
The shooting area enclosed by LED panels is called the LED Volume (or "the Volume" for short). A game engine like Unreal Engine renders the virtual scene live; through camera tracking, the perspective on the wall adjusts to match the camera's movement and lens data.
Functionality and Components
For the illusion to hold, the camera, LED wall, tracking, and render engine must work together in terms of timing and perspective. Key components include:
- Inner Frustum: the image area that the production camera actually sees. It is rendered in the highest resolution and moves live with the tracked camera.
- Outer Frustum: the remaining wall area not captured by the camera. It is rendered in lower quality and primarily serves as a light and reflection source.
- Camera Tracking: captures the camera's position, orientation, and lens/focal length data to correctly follow the perspective and focus plane.
- Genlock: synchronizes the camera, render computer, and LED processors to the same frequency, thus preventing flicker and image tearing.
Significance for Lighting and Set
For lighting and grip, the LED wall is not just a background but an active light source: the panels emit real light, creating color-matched fill light, interactive practical lighting (e.g., fire, screens, day-night moods), and realistic reflections on actors, costumes, and shiny surfaces.
Reflections on curved, glossy surfaces often come from the Outer Frustum, i.e., the wall areas outside the camera's field of view. In practice, conventional lighting fixtures and grip equipment (negative fill, flags, hard accent lights) complement the broad lighting effect of the wall, as the LED light is rather soft and diffuse.