The VFX process of analyzing and recreating the camera movement from live-action footage in 3D software – enabling CG elements to be inserted into shots with correct perspective, position, and motion so they appear locked to the real-world environment.
What is Matchmove?
Matchmove (also Camera Tracking or 3D Tracking) is the VFX process of analyzing and reconstructing camera movement from live-action footage in 3D. This allows for the seamless integration of CG elements into shot material.
Basic Principle
| Aspect | Description |
|---|---|
| Input | Live-action footage |
| Analysis | Feature tracking |
| Output | 3D Camera + Geometry |
| Purpose | CG Integration |
Tracking Types
| Type | Description |
|---|---|
| Camera Solve | Reconstruct camera movement |
| Object Track | Track object in shot |
| Body Track | Track body movement |
| Planar Track | Planar tracking |
Camera Solve
| Element | Description |
|---|---|
| Position | XYZ coordinates |
| Rotation | Orientation |
| Focal Length | Focal length |
| Lens Distortion | Distortion |
Workflow
| Phase | Activity |
|---|---|
| 1 | Import footage |
| 2 | Track markers |
| 3 | Camera Solve |
| 4 | Export to 3D software |
Feature Tracking
| Method | Description |
|---|---|
| Auto-Track | Automatic point detection |
| Manual Track | Manual placement |
| Hybrid | Combination |
| Supervision | Correction |
Tracking Markers
| Type | Description |
|---|---|
| Physical Markers | Placed on set |
| Natural Features | Existing points |
| Contrast Points | Areas of contrast |
| Edges | Edges |
Software
| Tool | Description |
|---|---|
| 3DEqualizer | Industry standard |
| PFTrack | Pixel Farm |
| SynthEyes | Budget option |
| Nuke | Integrated tracking |
3DEqualizer
| Feature | Description |
|---|---|
| Precision | Highest |
| Features | Comprehensive |
| Industry | Major Studios |
| Training | Demanding |
On-Set Requirements
| Element | Importance |
|---|---|
| Tracking Markers | Very high |
| Lens Data | Critical |
| Survey | For scale |
| HDRI/Reference | For lighting |
Lens Distortion
| Aspect | Description |
|---|---|
| Undistort | Remove distortion |
| Redistort | Back to comp |
| Grid Shot | For analysis |
| Lens Files | Calibration |
Lidar Integration
| Application | Description |
|---|---|
| Survey | Set geometry |
| Reference | For tracking |
| Scale | Real measurements |
| Detail | Complex environments |
Point Cloud
| Element | Description |
|---|---|
| Tracked Points | 3D positions |
| Density | The more, the better |
| Distribution | Spread across frames |
| Quality | Accuracy |
Export
| Format | Destination |
|---|---|
| Maya | .ma/.mb |
| Nuke | .nk Script |
| FBX | Universal |
| Alembic | Animation |
Challenges
| Problem | Solution |
|---|---|
| Motion Blur | Short shutter |
| Featureless Areas | Place markers |
| Reflections | Avoid tracking |
| Rolling Shutter | Correction |
Quality Control
| Check | Method |
|---|---|
| Locator Test | Place geo on track |
| Lineup | Original vs. Render |
| Subtle Move | Detect drifts |
| Edge Cases | Extreme positions |
Object Tracking
| Application | Examples |
|---|---|
| Vehicles | Insert CG cars |
| Hands | Object replacement |
| Faces | Face track |
| Props | Digital enhancement |
Body Tracking
| Method | Description |
|---|---|
| Marker-Based | Points on the body |
| Markerless | ML-based |
| Rotomation | Re-animate |
| Hybrid | Combination |
Pipeline Position
| Predecessor | Matchmove | Successor |
|---|---|---|
| Editorial | Tracking | Animation |
| Plate Prep | → | Lighting |
| → | Compositing |
Best Practices
| Practice | Reason |
|---|---|
| On-Set Data | Facilitates post-production |
| Clean Plates | For tracking |
| Lens Grid | Resolve distortion |
| Documentation | For handoff |
Today
Matchmove is a fundamental VFX technique – without precise tracking, there are no convincing CG integrations. Modern software and ML-based tools simplify the process, but the fundamentals remain: good feature detection, correct lens data, and careful quality control. On-set preparation with markers and survey remains essential for complex shots.