Datasets

A number of publicly available datasets have been used to train and evaluate the OpenFace system, this page lists all of the datasets used. Without the availability of these datasets, OpenFace would not be possible and we thank their creators.

Datasets used for training AUs in OpenFace

Action Unit predictors have been trained and evaluated on the following datasets:

• Bosphorus
• BP4D from FERA2015
• DISFA
• FERA2011
• SEMAINE from FERA2015
• UNBC
• CK+

More details on the actual training procedure can be found here - https://github.com/TadasBaltrusaitis/OpenFace/blob/master/matlab_version/AU_training/instructions.txt

Datasets used for evaluating head pose

• ICT-3DHP
• [Boston University] (http://www.cs.bu.edu/groups/ivc/data.php)
• [Biwi] (https://data.vision.ee.ethz.ch/cvl/gfanelli/head_pose/head_forest.html)

Datasets used for evaluating eye gaze

• MPII, note we used a private subset with full face images that is not available to the public