Motion tracking technique that follows flat surfaces rather than individual points – analyzes how rectangular regions move, rotate, scale, and perspectively distort over time, essential for replacing screens, signs, and other planar surfaces in VFX and compositing work.
What is Planar Tracking?
Planar Tracking is a tracking technique for flat surfaces that tracks an entire area instead of individual points. It analyzes translation, rotation, scale, and perspective distortion.
Basic Principle
| Aspect | Description |
|---|---|
| Method | Surface Analysis |
| Tracking Type | 2.5D (Pseudo-3D) |
| Data | 4-Point Transform |
| Application | Screen Replacement |
Difference to Point Tracking
| Aspect | Planar | Point |
|---|---|---|
| Unit | Surface | Single Point |
| Data | 4+ Points | 1 Point |
| Perspective | Yes | No |
| Robustness | Higher | Lower |
Tracking Data
| Parameter | Description |
|---|---|
| Translation | X/Y Movement |
| Rotation | Rotation |
| Scale | Size Change |
| Perspective | Perspective Distortion |
| Shear | Shear |
Software
| Program | Description |
|---|---|
| Mocha Pro | Industry Standard |
| Mocha AE | After Effects Version |
| Nuke (Planar) | Integrated |
| DaVinci Resolve | Fusion Tracker |
Mocha Pro
| Feature | Description |
|---|---|
| Developer | Boris FX |
| Strength | Planar Tracking |
| Integration | Plugin + Standalone |
| Features | Remove, Insert, Stabilize |
Workflow
| Step | Description |
|---|---|
| 1. Define | Mark Tracking Area |
| 2. Track | Analysis over Time |
| 3. Refine | Manual Corrections |
| 4. Export | Data to Compositor |
| 5. Apply | Corner Pin/Transform |
Applications
| Area | Example |
|---|---|
| Screen Replacement | TV, Phone, Monitor |
| Sign Replacement | Signs, Posters |
| Window | Window Views |
| Compositing | Element Integration |
Screen Replacement
| Step | Description |
|---|---|
| Track Surface | Screen Area |
| Clean Plate | Remove Original |
| Insert | New Content |
| Match | Reflections, Color |
Challenges
| Problem | Solution |
|---|---|
| Motion Blur | Fewer Frames, Manual |
| Partially Obscured | Exclude Areas |
| Low Texture | Larger Area |
| Lens Distortion | Correct in Advance |
Best Practices – Tracking
| Practice | Reason |
|---|---|
| Larger Area | More Data |
| High Contrast | Better Features |
| Exclude Moving Objects | Avoid Disturbances |
| Check Backwards | Quality Control |
Corner Pin
| Type | Description |
|---|---|
| Standard | 4 Corners, Perspective |
| Bilinear | For Curved Surfaces |
| Grid Warp | Complex Deformation |
| Mesh | Very Detailed |
Export Formats
| Format | Target |
|---|---|
| Corner Pin | After Effects |
| Transform Matrix | Nuke |
| Tracking Data | Universal |
| Shapes | Roto Splines |
Stabilization
| Application | Description |
|---|---|
| Planar Stabilize | Stabilize Surface |
| Remove | Object Removal |
| Clean Plate | Repair Background |
| Match Move | Insert Elements |
Remove Module
| Step | Description |
|---|---|
| Track | Object to Remove |
| Background | Track Background |
| Illuminate | Lighting Compensation |
| Render | Clean Background |
Insert Module
| Feature | Description |
|---|---|
| Insert Clip | New Content |
| Match Grain | Match Film Grain |
| Composite | Blending Modes |
| Render | Final Result |
Lens Module
| Function | Description |
|---|---|
| Calibration | Lens Parameters |
| Undistort | Remove Distortion |
| Redistort | Reapply |
| Export | Lens Profile |
Tips for Shooting
| Tip | Reason |
|---|---|
| Tracking Markers | For Solid Color Surfaces |
| Contrast | Visible Edges |
| Clean | No Reflections |
| Reference | Clean Plate Shot |
Today
Planar tracking is a fundamental VFX technique for screen replacements and compositing work. The technology has evolved significantly and today also enables complex removals and insertions. Mocha Pro remains the industry standard, while integration into NLEs and compositors makes planar tracking accessible for all production sizes.