Filmlexikon.
Support
Facial Capture
Camera · Technique

Facial Capture

Murnau AI illustration
face scan performance capture face replacement

Recording an actor's facial expressions, typically via head-mounted camera (HMC), to transfer onto a digital character.

Overview

Facial Capture (also Face Capture) refers to the recording of an actor's facial expressions and their transfer to a digital character. Subtle movements such as blinks, lip movements, eyebrow raises, and cheek tension are captured. Facial Capture is a sub-discipline of Performance Capture; if facial capture is combined with body motion capture, it is referred to as full Performance Capture.

Unlike pure body motion capture, which relies on optical marker systems in space, facial capture today is mostly done via a camera attached to the performer's head. This allows the actor to move freely while their face is continuously recorded. The recordings are then transferred to the digital character's facial rig in a step called "solving" (retargeting).

Methods

In practice, two fundamental approaches are distinguished:

MethodPrincipleCharacteristics
Marker-basedPainted or adhered dots/markers on the face are tracked by cameras.High resolution of individual tracking points; disruptive for the performer; can force more exaggerated acting.
MarkerlessNatural facial features (nostrils, lip corners, eyes, wrinkles) are tracked via image analysis without markers.Less restrictive for the performer; computationally intensive; benefits greatly from high resolution and frame rate.

Head-Mounted Cameras (HMC) played a central role in the proliferation of markerless methods: first widely used in the pre-production of James Cameron's "Avatar" (2009).

Head-Mounted Camera (HMC)

The HMC is a helmet- or rig-like device whose arm holds one or more cameras pointed at the face. Depending on the model, this typically involves between one and four cameras; the design and manufacturer vary greatly. Because the camera moves with the head, it provides a constant, frame-filling image of the face – regardless of where the performer moves within the capture volume.

On-Set Usage

Facial Capture is used when an actor's facial expressions are intended to drive a fully or partially digital character – for example, for photorealistic CG characters, creatures, or avatars in feature films, series, and video games. The performer wears the HMC (often in addition to a motion capture suit for the body), performs the scene, and the facial data is subsequently transferred to the digital face in the VFX pipeline. Machine learning is increasingly used to automate the solve from real facial expressions to the character rig.

From the crafts

Perspectives

Cinematographer

Ich muss die Hauptkameras so positionieren, dass die Head-Mounted-Rigs nicht ins Bild ragen – das schränkt Nahaufnahmen und Profile stark ein. Die IR-Beleuchtung der Capture-Kameras kann bei gemischtem Licht Farbstiche verursachen, weshalb ich oft separate Lighting-Setups für Facial-Capture-Szenen plane.

Director

Ich kann endlich subtile Nuancen wie das Zucken eines Augenlids oder minimale Lippenverzerrungen auf fantastische Kreaturen übertragen, die traditionelle Animation nie erreichen würde. Allerdings muss ich Schauspieler intensiver coachen, da jede Micro-Expression verstärkt wird – Josh Brolin musste für Thanos seine gewohnte Mimik um 20% reduzieren.

Producer

Ein Standard-Facial-Capture-Setup kostet $50.000-150.000 täglich inklusive Techniker, plus 4-6 Wochen zusätzliche Postproduktion pro Charakter. Die Amortisation lohnt sich ab 20+ Minuten Screentime digitaler Charaktere – darunter ist klassische Animation oft günstiger und schneller umsetzbar.

More in the lexikon

Related terms

Test your knowledge

Quiz

1. Zu welchem Department gehört „Facial Capture"?

2. Wie viele verschiedene Fachperspektiven bietet dieser Eintrag?

Report an error
From the Filmfarm ecosystem

Understand visual language, budget productions, connect crew.

The Lexikon is part of the Filmfarm ecosystem — alongside budgeting (FilmBalance), an industry magazine (FilmCircus) and crew networking (FilmCall, CrewMesh). One shared vocabulary for the whole production.

FilmFarm FilmRadarComing soonFilmPulseComing soonFilmNumbersComing soonFilmCapitalComing soonFilmLabComing soonFilmBalanceComing soonFilmCircusComing soon