FaceRig

FaceRig

89 ratings
[Official FaceRig Guide] Advanced Face Tracking Calibration Tutorial
By Carmen the Human Minion and 1 collaborators
This guide describes the basic principles of video face tracking in FaceRig and it teaches you how to calibrate it for a better experience. Keep in mind that FaceRig uses video and audio tracking for lip movement, so for a better understanding of this tutorial we suggest turning audio Lipsync off.
   
Award
Favorite
Favorited
Unfavorite
Expression Units explained. Calibration in general.
Face Tracking is based on Expression Units mapped to specific face features and also to the avatar's gesture animation. They are basically defined by a numeric value which changes as you gesture. This value covers a slightly different interval from person to person, that means the minimum and maximum values you reach for each Expression Unit must be configured accordingly for your own face. FaceRig's default Expression Units intervals were configured such that it should work for each of our team members with a 70-90% accuracy.

The Expression Units are used to fine tune the tracking based on your appearance
and/or preferences. For example, if you want your avatar to keep his eyes half closed, here's
where you can adjust the values to get that result.
All expression units have a disable option so you can choose if you want the avatar to
completely ignore certain actions (for example pursed lips).
Tracker Input Range shows the minimum and maximum values for different
expressions. Min white bar means minimum value and has a certain action linked with it (e.g.
closed mouth), Max white bar represents the maximum value and has the opposite action
from the Max white bar linked to it (e.g. open mouth), and the black bar is the actual value that
the tracker outputs based on the user's actions.
To adjust the interval just pull the sliders.

You should drag the min and max markers such that the tracked value (the black marker) could reach both of them while doing specific face expressions (like moving your eyebrows up and down). Note that you cannot move the min marker on the right of the max one, and the max one to the left of the min one.


The Smoothing slider in the window interface. The Smoothing value filters the tracked value (the black marker) to reduce jitter/noise caused by various reasons (webcam image resolution, fps, image blurriness, bad lighting etc). Configuring Smoothing slider can achieve:
  • with higher smoothing values - reduced uncontrollable avatar movements and also smoothed movements, but you will also delay the avatar reaction (it will seem like a lag)
  • with lower smoothing values - responsive avatar movements, but the animation may be a little jittery



You can also disable a specific Expression Unit by pressing the Disable button if you are not satisfied with the tracking after calibrating it, but we recommend to try to make it work for you for a complete FaceRig experience :).
How to calibrate Jaw Drop
How to calibrate Purse Lips
How to calibrate Lip Stretch
How to calibrate Upper Lip Raiser
How to calibrate Eye Brows

How to calibrate Eye Pupil Position
How to calibrate Eye Closing (Fixing Lazy Eye Bug)
Pursed Lips Left/Right
9 Comments
HeliosTXG 18 Mar, 2021 @ 8:09pm 
I actually have a problem with the jaw derping to the left, hopefully these help me figure that one out, lol
cocoayoc 19 Mar, 2020 @ 8:08am 
where'd the videos go?
Noldo 20 Apr, 2017 @ 12:44am 
why your content is empty?
76561198162644749 6 Aug, 2015 @ 3:35am 
@spigias Awesome! Feel free to post on the forums if you have any questions ;)
spigias 5 Aug, 2015 @ 3:36am 
great help thank you!
Vropoliz5 23 Feb, 2015 @ 11:09pm 
How do you fix the tracker feed. My one just froze completely, is there a way to fix it. I assume when re-opening it it should fix it self. Ii just wanting to know if there is anyway to fix delays/lag in the tracker. Sometimes (before it froze just then) it would be delayed and glitch up the character abit. Is there a way to resolve this lag tracker issue with the camera?
Tryyton 25 Sep, 2014 @ 6:04pm 
nice guide, thanks
TrueChaoS 23 Sep, 2014 @ 1:26am 
@Din85:

http://steamproxy.net/app/274920/discussions/2/613935404221245524/

This thread might help you fix a few of your issues.
Din Fox Girl 19 Sep, 2014 @ 9:21am 
Is there a fix for glasses users? It appears that the reflection from my glasses makes everything mess up.