Combining Deep Facial and Ambient Features for First Impression Estimation
Loading...
Files
Date
2016
Journal Title
Journal ISSN
Volume Title
Publisher
Springer International Publishing Ag
Access Rights
info:eu-repo/semantics/openAccess
Abstract
First impressions influence the behavior of people towards a newly encountered person or a human-like agent. Apart from the physical characteristics of the encountered face, the emotional expressions displayed on it, as well as ambient information affect these impressions. In this work, we propose an approach to predict the first impressions people will have for a given video depicting a face within a context. We employ pre-trained Deep Convolutional Neural Networks to extract facial expressions, as well as ambient information. After video modeling, visual features that represent facial expression and scene are combined and fed to a Kernel Extreme Learning Machine regressor. The proposed system is evaluated on the ChaLearn Challenge Dataset on First Impression Recognition, where the classification target is the Big Five personality trait labels for each video. Our system achieved an accuracy of 90.94% on the sequestered test set, 0.36% points below the top system in the competition.
Description
14th European Conference on Computer Vision (ECCV) -- OCT 08-16, 2016 -- Amsterdam, NETHERLANDS
Keywords
Personality traits, First impression, Deep learning, ELM, Face, Inferences, Competence
Journal or Series
Computer Vision - Eccv 2016 Workshops, Pt Iii
WoS Q Value
N/A
Scopus Q Value
Q3
Volume
9915
