🐱FER Datasets

🐱FER Challenges

🐱Related Reviews

🐱Facial Expression Recognition (FER)

🐱Cross-Dataset FER

🐱Facial Action Unit Recognition

🐱Affective Level Estimation

FER Datasets

• Jaffe
• FER-2013
• MMI Facial Expression Database
• Cohn-Kanade Expression Database
• Oulu-CASIA NIR&VIS facial expression database
• Multi-PIE
• BU-3DFE (Binghamton University 3D Facial Expression) Database
• Real-world Affective Faces (RAF) Database
• AffectNet
• EmotioNet Database
• The Radboud Faces Database (RaFD)
• Aff-Wild data
• A novel database of Children’s Spontaneous Facial Expressions (LIRIS-CSE) [paper]

FER Challenges

• Emotion Recognition in the Wild Challenge (EmotiW) @ ICMI
  • EmotiW 2018
  • EmotiW 2017
  • EmotiW 2016
  • EmotiW 2015
  • EmotiW 2014
  • EmotiW 2013
• Audio/Visual Emotion Challenge (AVEC) @ ACM MM
• Facial Expression Recognition and Analysis Challenge (FERA) @ FG
• One-Minute Gradual-Emotion Behavior Challenge @ IJCNN
• EmotioNet Challenge
• Real Versus Fake Expressed Emotions @ ICCV
• Affect-in-the-Wild Challenge @ CVPR

Related Reviews

• (ACM Computing Surveys 19) Facial Expression Analysis under Partial Occlusion: A Survey [paper]
• (IEEE Transactions on Affective Computing 19) Deep Learning for Human Affect Recognition: Insights and New Developments [paper]
• (IEEE Transactions on Affective Computing 18) Survey on Emotional Body Gesture Recognition [paper]
• (IEEE Transactions on Affective Computing 17)Automatic Analysis of Facial Actions: A Survey [paper]
• (IEEE Transactions on Pattern Analysis and Machine Intelligence 16) Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications[paper]
• (Image and Vision Computing 13) Categorical and dimensional affect analysis in continuous input: Current trends and future directions [paper]
• (FG 11) Emotion representation, analysis and synthesis in continuous space: A survey [paper]
• Deep Facial Expression Recognition: A Survey [paper]

Facial Expression Recognition

AAAI

• (2019) Mode Variational LSTM Robust to Unseen Modes of Variation: Application to Facial Expression Recognition [paper]
• (2019) Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation [paper]
• (2019) CycleEmotionGAN: Emotional Semantic Consistency Preserved CycleGAN for Adapting Image Emotions [paper]
• (2018) ExprGAN: Facial Expression Editing with Controllable Expression Intensity [paper],[code][:dizzy:]
• (2018) Learning Spatio-temporal Features with Partial Expression Sequences for on-the-Fly Prediction [paper][:dizzy:]

ACM MM

• (2018) Fast and Light Manifold CNN based 3D Facial Expression Recognition across Pose Variations [paper]
• (2018) Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach [paper]
• (2018) Facial Expression Recognition Enhanced by Thermal Images through Adversarial Learning [paper]
• (2018) Geometry Guided Adversarial Facial Expression Synthesis [paper]
• (2018) Conditional Expression Synthesis with Face Parsing Transformation [paper]

ICCV

• (2017) A Novel Space-Time Representation on the Positive Semidefinite Cone for Facial Expression Recognition [paper][:dizzy:]
• (2017) (workshop) Facial Expression Recognition via Joint Deep Learning of RGB-Depth Map Latent Representations [paper][:dizzy:]
• (2017) (workshop) Facial Expression Recognition using Visual Saliency and Deep Learning [paper][:dizzy::dizzy:]
• (2015) Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]
• (2015) Pairwise Conditional Random Forests for Facial Expression Recognition [paper][:dizzy:]

ECCV

• (2018) Facial Expression Recognition with Inconsistently Annotated Datasets [paper]
• (2018) Contemplating Visual Emotions: Understanding and Overcoming Dataset Bias [paper]
• (2018) Deep Multi-Task Learning to Recognise Subtle Facial Expressions of Mental States [paper]
• (2016) Peak-Piloted Deep Network for Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]

CVPR

• (2018) Facial Expression Recognition by De-expression Residue Learning [paper][:dizzy::dizzy::dizzy:]
• (2018) Joint Pose and Expression Modeling for Facial Expression Recognition [paper],[code][:dizzy::dizzy:]
• (2018) 4DFAB: A Large Scale 4D Database for Facial Expression Analysis and Biometric Applications [paper][:dizzy:]
• (2018) (workshop) Covariance Pooling for Facial Expression Recognition [paper],[code][:dizzy:]
• (2018) (workshop) Unsupervised Features for Facial Expression Intensity Estimation over Time [paper][:dizzy::dizzy:]
• (2018) (workshop) A Compact Deep Learning Model for Robust Facial Expression Recognition [paper][:dizzy:]
• (2017) Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild [paper][:dizzy:]
• (2017) Emotion Recognition in Context [paper][:dizzy:]
• (2017) (workshop) Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks [paper][:dizzy:]
• (2017) (workshop) Estimation of Affective Level in the Wild With Multiple Memory Networks [paper][:dizzy::dizzy:]
• (2017) (workshop) DyadGAN: Generating Facial Expressions in Dyadic Interactions [paper][:dizzy:]
• (2017) (workshop) Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions [paper][:dizzy::dizzy:]
• (2016) LOMo: Latent Ordinal Model for Facial Analysis in Videos [paper][:dizzy:]
• (2016) Facial Expression Intensity Estimation Using Ordinal Information [paper],[Supplementary][:dizzy::dizzy:]
• (2016) EmotioNet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild [paper],[Supplementary][:dizzy:]
• (2016) Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis [paper][:dizzy:]
• (2016) (workshop) Automatic Recognition of Emotions and Membership in Group Videos [paper][:dizzy:]
• (2016) (workshop) Extended DISFA Dataset: Investigating Posed and Spontaneous Facial Expressions [paper][:dizzy:]
• (2014) Learning Expressionlets on Spatio-Temporal Manifold for Dynamic Facial Expression Recognition [paper][:dizzy::dizzy:]
• (2014) Facial Expression Recognition via a Boosted Deep Belief Network [paper][:dizzy:]
• (2013) Capturing Complex Spatio-Temporal Relations among Facial Muscles for Facial Expression Recognition [paper][:dizzy:]

IJCAI

• (2018) Personality-Aware Personalized Emotion Recognition from Physiological Signals [paper]

BMVC

• (2018) Feature Selection Mechanism in CNNs for Facial Expression Recognition [paper]

WACV

• (2016) Going Deeper in Facial Expression Recognition using Deep Neural Networks [paper][:dizzy:]

ICMI

• (2018) Multi-Feature Based Emotion Recognition for Video Clips [paper]
• (2018) Video-based Emotion Recognition Using Deeply-Supervised Neural Networks [paper]
• (2018) Multiple Spatio-temporal Feature Learning for Video-based Emotion Recognition in the Wild [paper]
• (2018) An Occam’s Razor View on Learning Audiovisual Emotion Recognition with Small Training Sets [paper]
• (2018) Group-Level Emotion Recognition Using Hybrid Deep Models Based on Faces, Scenes, Skeletons and Visual Attentions [paper]
• (2018) Cascade Attention Networks For Group Emotion Recognition with Face, Body and Image Cues [paper]
• (2018) Group-Level Emotion Recognition using Deep Models with A Four-stream Hybrid Network [paper]
• (2018) An Attention Model for group-level emotion recognition[paper]
• (2017) Learning supervised scoring ensemble for emotion recognition in the wild [paper]
• (2017) Convolutional neural networks pretrained on large face recognition datasets for emotion classification from video [paper]
• (2017) Temporal Multimodal Fusion for Video Emotion Classification in the Wild [paper]
• (2017) Emotion recognition with multimodal features and temporal models [paper]
• (2017) Audio-visual emotion recognition using deep transfer learning and multiple temporal models [paper]

FG

• (2019) Generalizing to unseen head poses in facial expression recognition and action unit intensity estimation [paper]
• (2018) Facial Expression Grounded Conversational Dialogue Generation[paper]
• (2018) Island Loss for Learning Discriminative Features in Facial Expression Recognition [paper]
• (2018) Multi-Channel Pose-Aware Convolution Neural Networks for Multi-View Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]
• (2018) Automatic 4D Facial Expression Recognition using Dynamic Geometrical Image Network [paper][:dizzy:]
• (2018) ExpNet: Landmark-Free, Deep, 3D Facial Expressions [paper][code][:dizzy:]
• (2018) Perceptual Facial Expression Representation [paper][:dizzy:]
• (2018) Emotion-Preserving Representation Learning via Generative Adversarial Network for Multi-view Facial Expression Recognition [paper][:dizzy::dizzy:]
• (2018) Spotting the Details: The Various Facets of Facial Expressions [paper][:dizzy:]
• (2018) Identity-Adaptive Facial Expression Recognition Through Expression Regeneration Using Conditional Generative Adversarial Networks [paper][:dizzy::dizzy::dizzy:]
• (2018) Hand-crafted Feature Guided Deep Learning for Facial Expression Recognition [paper][:dizzy::dizzy:]
• (2018) Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition [paper][:dizzy:]
• (2018) Changes in Facial Expression as Biometric: A Database and Benchmarks of Identification [paper][:dizzy:]
• (2018) LTP-ML : Micro-Expression Detection by Recognition of Local temporal Pattern of Facial Movements [paper][:dizzy:]
• (2018) From Macro to Micro Expression Recognition: Deep Learning on Small Datasets Using Transfer Learning [paper][:dizzy:]
• (2017) Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition [paper][:dizzy:]
• (2017) FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition [paper][:dizzy::dizzy:]
• (2017) Deep generative-contrastive networks for facial expression recognition [paper][:dizzy::dizzy::dizzy:]
• (2017) Identity-Aware Convolutional Neural Network for Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]
• (2017) (workshop) Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields [paper][:dizzy:]
• (2017) Head Pose and Expression Transfer using Facial Status Score [paper][:dizzy:]
• (2017) Sayette Group Formation Task (GFT) Spontaneous Facial Expression Database [paper][:dizzy::dizzy:]
• (2017) Curriculum Learning for Facial Expression Recognition [paper][:dizzy:]
• (2017) Implicit Media Tagging and Affect Prediction from RGB-D video of spontaneous facial expressions [paper][:dizzy::dizzy:]
• (2015) Pairwise Linear Regression: An Efficient and Fast Multi-view Facial Expression Recognition [paper][:dizzy:]

IEEE Trans on Affective Computing

• (2018) Heterogeneous Knowledge Transfer in Video Emotion Recognition, Attribution and Summarization [paper][:dizzy::dizzy::dizzy:]
• (2018) Emotion Recognition in Simulated Social Interactions [paper]
• (2018) Co-clustering to reveal salient facial features for expression recognition[paper]
• (2018) Facial Expression Recognition with Identity and Emotion Joint Learning [paper]
• (2018) Unsupervised adaptation of a person-specific manifold of facial expressions [paper][:dizzy::dizzy::dizzy:]
• (2018) Multi-velocity neural networks for facial expression recognition in videos [paper][:dizzy::dizzy::dizzy:]
• (2018) Multi-Objective based Spatio-Temporal Feature Representation Learning Robust to Expression Intensity Variations for Facial Expression Recognition [paper]
• (2018) Visually Interpretable Representation Learning for Depression Recognition from Facial Images [paper][:dizzy::dizzy::dizzy::dizzy:]
• (2018) An Adaptive Bayesian Source Separation Method for Intensity Estimation of Facial AUs [paper][:dizzy::dizzy::dizzy::dizzy:]
• (2018) Facial Expression Recognition in Video with Multiple Feature Fusion [paper][:dizzy::dizzy:]
• (2018) The Indian Spontaneous Expression Database for Emotion Recognition[paper]

IEEE Access

• (2019) cGAN Based Facial Expression Recognition for Human-Robot Interaction [paper]
• (2018) Geometric-Convolutional Feature Fusion Based on Learning Propagation for Facial Expression Recognition [paper]
• (2018) Adaptive Feature Mapping for Customizing Deep Learning Based Facial Expression Recognition Model[paper]
• (2018) Facial Expression Recognition Using Weighted Mixture Deep Neural Network Based on Double-Channel Facial Images [paper]
• (2018) SMEConvNet: A Convolutional Neural Network for Spotting Spontaneous Facial Micro-Expression From Long Videos [paper]
• (2018) Dominant and Complementary Emotion Recognition From Still Images of Faces [paper]

IEEE Transactions on Image Processing

• (2018) Occlusion aware facial expression recognition using CNN with attention mechanism [paper]
• (2017) Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks [paper]
• (2013) Simultaneous Facial Feature Tracking and Facial Expression Recognition [paper]
• (2005) Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences [paper]

IEEE Transactions on Multimedia

• (2019) Facial Expression Recognition Using Hierarchical Features With Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks [paper]
• (2018) MixedEmotions: An Open-Source Toolbox for Multimodal Emotion Analysis [paper]

Computer Vision and Image Understanding

• (2019) Registration-free Face-SSD: Single shot analysis of smiles, facial attributes, and affect in the wild[paper]

IEEE Transactions on Cybernetics

• (2015) Learning Multiscale Active Facial Patches for Expression Analysis[paper]

Others

• (IEEE Journal of Selected Topics in Signal Processing17) End-to-End Multimodal Emotion Recognition using Deep Neural Networks [paper],[code]

Cross-Dataset FER

• (Neurocomputing18) Cross-domain Facial Expression Recognition via an Intra-category Common Feature and Inter-category Distinction feature Fusion Network [paper]
• Cross-database non-frontal facial expression recognition based on transductive deep transfer learning [paper]
• Unsupervised Domain Adaptation for Facial Expression Recognition Using Generative Adversarial Networks [paper]
• ICPR 18 Deep Emotion Transfer Network for Cross-database Facial Expression Recognition
• FG 2018 Deep Unsupervised Domain Adaptation for Face Recognition [paper][:dizzy::dizzy::dizzy:]
• FG 2018 Cross-generating GAN for Facial Identity Preserving [paper][:dizzy:]
• ACM MM 2017 Learning a Target Sample Re-Generator for Cross-Database Micro-Expression Recognition [paper][:dizzy:]
• TIP 2018 Domain Regeneration for Cross-Database Micro-Expression Recognition [paper][:dizzy:]
• CVPR 2013 Selective Transfer Machine for Personalized Facial Action Unit Detection [paper][:dizzy:]
• TPAMI 2017 Selective Transfer Machine for Personalized Facial Expression Analysis [paper]
• ICONIP 2016 Cross-Database Facial Expression Recognition via Unsupervised Domain Adaptive Dictionary Learning [paper](P428)[:dizzy:]
• IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 2018 Cross-Domain Color Facial Expression Recognition Using Transductive Transfer Subspace Learning [paper][:dizzy:]
• FG2018 Unsupervised Domain Adaptation with Regularized Optimal Transport for Multimodal 2D+3D Facial Expression Recognition [paper][:dizzy::dizzy:]
• ICB2016 Discriminative Feature Adaptation for Cross-Domain Facial Expression Recognition [paper][:dizzy:]
• ICB2015 A Transfer Learning Approach to Cross-Database Facial Expression Recognition [paper][:dizzy:]
• ICRA2011 Cross-dataset facial expression recognition [paper][:dizzy:]
• Neurocomputing2016 Transfer subspace learning for cross-dataset facial expression recognition [paper][:dizzy:]
• IEEE TRANSACTIONS ON MULTIMEDIA 2016 A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition [paper](Cross-view facial expression recognition)[:dizzy:]
• CVPR2014 Constrained Deep Transfer Feature Learning and its Applications [paper](Cross-view facial expression recognition)[:dizzy:]
• IEEE SIGNAL PROCESSING LETTERS 2016 Cross-Corpus Speech Emotion Recognition Based on Domain-Adaptive Least-Squares Regression [paper][:dizzy:]
• ICMI2017 Cross-Modality Interaction between EEG Signals and Facial Expression [paper][:dizzy:]
• ACM MM 2017 Integrated Face Analytics Networks through Cross-Dataset Hybrid Training[paper][:dizzy::dizzy:]

Facial Action Unit Recognition

CVPR

• (2018) Weakly-supervised Deep Convolutional Neural Network Learning for Facial Action Unit Intensity Estimation [paper]
• (2018) Learning Facial Action Units from Web Images with Scalable Weakly Supervised Clustering [paper]
• (2018) Classifier Learning with Prior Probabilities for Facial Action Unit Recognition [paper]
• (2018) Bilateral Ordinal Relevance Multi-instance Regression for Facial Action Unit Intensity Estimation [paper]
• (2018) Weakly Supervised Facial Action Unit Recognition through Adversarial Training [paper]
• (2017) Deep Structured Learning for Facial Action Unit Intensity Estimation [paper]
• (2017) Action Unit Detection with Region Adaptation, Multi-labeling Learning and Optimal Temporal Fusing [paper]
• (2016) Deep Region and Multi-label Learning for Facial Action Unit Detection [paper] [code] [code2]
• (2016) Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection [paper]
• (2016) Copula Ordinal Regression for Joint Estimation of Facial Action Unit Intensity [paper] [code]
• (2015) Latent Trees for Estimating Intensity of Facial Action Units [paper][code]
• (2015) Joint Patch and Multi-label Learning for Facial Action Unit Detection [paper]
• (2009) A framework for automated measurement of the intensity of non-posed Facial Action Units [paper]

ICCV

• (2017) DeepCoder: Semi-parametric Variational Autoencoders for Automatic Facial Action Coding [paper]
• (2017) Deep Facial Action Unit Recognition from Partially Labeled Data [paper]
• (2015) Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection [paper]
• (2015) Multi-conditional Latent Variable Model for Joint Facial Action Unit Detection [paper]
• (2015) Confidence Preserving Machine for Facial Action Unit Detection [paper]

ECCV

• (2018) Deep Structure Inference Network for Facial Action Unit Recognition [paper]
• (2018) Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment[paper]

ACM MM

• (2018) Personalized Multiple Facial Action Unit Recognition through Generative Adversarial Recognition Network [paper]

BMVC

• (2018) Identity-based Adversarial Training of Deep CNNs for Facial Action Unit Recognition [paper]
• (2018) Joint Action Unit localisation and intensity estimation through heatmap regression [paper] [code] [:dizzy::dizzy::dizzy::dizzy:]

FG

• (2018) Edge Convolutional Network for Facial Action Intensity Estimation [paper]
• (2017) Support Vector Regression of Sparse Dictionary-Based Features for View-Independent Action Unit Intensity Estimation [paper]
• (2017) Pose-independent Facial Action Unit Intensity Regression Based on Multi-task Deep Transfer Learning [paper]
• (2017) AUMPNet: Simultaneous Action Units Detection and Intensity Estimation on Multipose Facial Images Using a Single Convolutional Neural Network [paper]
• (2017) EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detection [paper]
• (2015) Deep Learning based FACS Action Unit Occurrence and Intensity Estimation [paper]
• (2015) How much training data for facial action unit detection? [paper]
• (2015) Facial Action Units Intensity Estimation by the Fusion of Features with Multi-kernel Support Vector Machine [paper]
• (2015) A Unified Probabilistic Framework For Measuring The Intensity of Spontaneous Facial Action Units [paper]

IEEE Transactions on Image Processing

• (2018) Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label Dependencies [paper]
• (2016) Joint Patch and Multi-label Learning for Facial Action Unit and Holistic Expression Recognition [paper]

IEEE Transactions on Pattern Analysis and Machine Intelligence

• (2015) Discriminant Functional Learning of Color Features for the Recognition of Facial Action Units and their Intensities [paper]
• (2015) Context-Sensitive Dynamic Ordinal Regression for Intensity Estimation of Facial Action Units [paper]

IEEE Transactions on Affective Computing

• (2017) Copula Ordinal Regression Framework for Joint Estimation of Facial Action Unit Intensity[paper]

Pattern Recognition

• (2017) Feature and label relation modeling for multiple-facial action unit classification and intensity estimation [paper]

Image and Vision Computing

• (2016) Real-time facial action unit intensity prediction with regularized metric learning [paper]
• (2012) Regression-based intensity estimation of facial action units [paper]

Journal of Visual Communication and Image Representation

• (2017) A joint dictionary learning and regression model for intensity estimation of facial AUs [paper]

Others

• Region-based facial representation for real-time Action Units intensity detection across datasets [paper]
• (ACII17) Local-Global Ranking for Facial Expression Intensity Estimation [paper]
• (Pattern Recognition Letters14) Estimating smile intensity: A better way [paper] [:dizzy::dizzy::dizzy::dizzy:]
• (nccv15) Deep Learning based FACS Action Unit Occurrence and Intensity Estimation [paper]
• Conditional Adversarial Synthesis of 3D Facial Action Units [paper] [:dizzy::dizzy::dizzy:]
• (NIPS16) Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognition [paper]
• (ICIP14) Facial action unit intensity estimation using rotation invariant features and regression analysis [paper]
• (IEEE Transactions on Cybernetics 16) Intensity Estimation of Spontaneous Facial Action Units Based on Their Sparsity Properties [paper]
• Projects [Computer Expression Recognition Toolbox] [TAUD 2011] [LAUD 2010] [Openface] [[Openface-Paper](OpenFace: an open source facial behavior analysis toolkit)]

Affective Level Estimation

Dataset

• AffectNet [Website]
• (IEEE TRANSACTIONS ON AFFECTIVE COMPUTING) AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild [paper]
• EMOTIC dataset [Website]
• (CVPR17) Emotion Recognition in Context [paper][Supp]
• (CVPR17 workshop) EMOTIC: Emotions in Context Dataset
• Aff-Wild DATASET[Website]
• Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond [paper]
• (CVPR17 workshop) Aff-Wild: Valence and Arousal ‘in-the-wild’ Challenge [paper]
• HAPPEI dataset (happiness intensity)
• DISFA [Website](AUs)
• (IEEE TRANSACTIONS ON AFFECTIVE COMPUTING13) DISFA: A Spontaneous Facial Action Intensity Database [paper]
• GENKI-4K [Website](smile&non-smile)
• Proposed Methods validated using GENKI-4K :
• (ICCVW17) 95.76 SmileNet: Registration-Free Smiling Face Detection In The Wild [paper][project]
• (Machine Vision and Applications17) 92.05 Smile detection in the wild with deep convolutional neural networks [paper]
• (ACPR15) 94.6 Facial smile detection based on deep learning features. [paper]
• AFFECTIVA-MIT AM-FED [Website](smile&non-smile)
• Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected In-the-Wild [paper]
• Binghamton Pittsburgh 4D Spontaneous Expression datase (BP4D) [Website]
• The UNBC-McMaster Shoulder Pain Expression Archive Database

Challenges

• Group-level happiness intensity recognition @ EmotiW16 [Website]
• First Affect-in-the-Wild Challenge [Website]

Related Works

• (ICMI16) Happiness level prediction with sequential inputs via multiple regressions [paper]
• (CVPR17 workshop) Estimation of Affective Level in the Wild With Multiple Memory Networks [paper]
• (ICMI16) Group Happiness Assessment Using Geometric Features and Dataset Balancing [paper]
• (ICMI17) Group Emotion Recognition with Individual Facial Emotion CNNs and Global Image Based CNNs [paper]
• Feature Extraction via Recurrent Random Deep Ensembles and its Application in Gruop-level Happiness Estimation [paper]
• (ICPR18) Deep Spatiotemporal Representation of the Face for Automatic Pain Intensity Estimation [paper]
• Learning Pain from Action Unit Combinations: A Weakly Supervised Approach via Multiple Instance Learning [paper]
• (CVPR17) Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions [paper]
• (ICIP17) REGULARIZING FACE VERIFICATION NETS FOR PAIN INTENSITY REGRESSION [paper]
• (CVPR17 Workshop) Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video [paper]
• Multi-Instance Dynamic Ordinal Random Fields for Weakly-supervised Facial Behavior Analysis [paper]
• (FG17) Generic to Specific Recognition Models for Group Membership Analysis in Videos [paper]
• (Neurocomputing18)Facial expression intensity estimation using Siamese and triplet networks [paper]
• (Neurocomputing16) A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenarios [paper]
• (IEEE trans on Affective Computing11) Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal Space [paper]

Happiness (smile intensity estimation)

• (IEEE Transactions on Pattern Analysis and Machine Intelligence 09) Toward Practical Smile Detection [paper]
• (Multimedia Tools and Applications18) Smile intensity recognition in real time videos: fuzzy system approach[paper]
• (ACM Transactions on Intelligent Systems and Technology18) The Effect of Pets on Happiness: A Large-Scale Multi-Factor Analysis Using Social Multimedia [paper]
• (ICMSS '17) Happy Index: Analysis Based on Automatic Recognition of Emotion Flow [paper]
• (ICPR 2012)Group Expression Intensity Estimation in Videos via Gaussian Processes [paper]
• A Novel Approach to Detect Smile [paper]
• (ICCV17 Workshop) SmileNet: Registration-Free Smiling Face Detection In The Wild [paper][project]
• (ACII17) Smiling from Adolescence to Old Age: A Large Observational Study [paper]
• Deep Convolutional Neural Networks for Smile Recognition [paper]
• Embedded Implementation of a Deep Learning Smile Detector [paper]
• Smile detection in the wild based on transfer learning [paper]
• Appearance-based smile intensity estimation by cascaded support vector machines [paper]
• Smile detection in the wild with deep convolutional neural networks [paper]
• Fast and Robust Smile Intensity Estimation by Cascaded Support Vector Machines [paper]

Painful Expression Intensity Estimation

• (IEEE Transactions on Affective Computing 19) Multi-modal Pain Intensity Recognition based on the SenseEmotion Database [paper]
• (ICMI17) Cumulative Attributes for Pain Intensity Estimation [paper]
• (CVPRW16)Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video[paper][:dizzy::dizzy::dizzy:]
• (CVPRW15)Pain Recognition using Spatiotemporal Oriented Energy of Facial Muscles[paper]
• (CVPR17) Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions [paper][:dizzy::dizzy:]
• (FG15)Weakly Supervised Pain Localization using Multiple Instance Learning [paper]
• (ICIP17) REGULARIZING FACE VERIFICATION NETS FOR PAIN INTENSITY REGRESSION [paper][code]
• (ICME13) PAIN DETECTION THROUGH SHAPE AND APPEARANCE FEATURES [paper]
• (ICPR14) Pain Intensity Evaluation Through Facial Action Units [paper]
• (ieee trans on affective computing) Automatic Pain Assessment with Facial Activity Descriptors [paper]

Attention

• (ACM MM17) Fine-Grained Recognition via Attribute-Guided Attentive Feature Aggregation [paper]
• (ACM MM18) visual spatial attention network for relationship detection [paper]
• (ACM MM18) Attribute-Aware Attention Model for Fine-grained Representation Learning [paper]
• (ACM MM18) Attention-based Multi-Patch Aggregation for Image Aesthetic Assessment [paper]
• (ACM MM18) Attention-based Pyramid Aggregation Network for Visual Place Recognition [paper]
• (CVPR18) Attention-Aware Compositional Network for Person Re-identification [paper]
• (CVPR18) PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection [paper]
• (CVPR18) Emotional Attention: A Study of Image Sentiment and Visual Attention [paper]
• (CVPR16) Learning Deep Features for Discriminative Localization [paper][code]
• (CVPR18) Non-local Neural Networks [paper]
• (ECCV18) Interaction-aware Spatio-temporal Pyramid Attention Networks for Action Classification [paper]
• (ECCV18) CBAM: Convolutional Block Attention Module [paper]
• (CVPR18) Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification[paper]
• (CVPR18) Attention-Aware Compositional Network for Person Re-identification [paper]
• (ICCV17) A Coarse-Fine Network for Keypoint Localization [paper]
• Video-based Person Re-identification via 3D Convolutional Networks and Non-local Attention [paper]
• (AAAI19) Dual Attention Network for Scene Segmentation [paper]
• (ECCV18) Small-scale Pedestrian Detection Based on Topological Line Localization and Temporal Feature Aggregation [paper]
• (ECCV2018) CornerNet: Detecting Objects as Paired Keypoints [paper][code]
• (ECCV2018) DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks [paper]
• (ECCV18) Video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation [paper]
• (ECCV18) Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-identification [paper]
• (ECCV18) Deep Imbalanced Attribute Classification using Visual Attention Aggregation [paper]
• (ECCV18) Deep Adversarial Attention Alignment for Unsupervised Domain Adaptation: the Benefit of Target Expectation Maximization [paper]
• (ECCV18) Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment [paper]