Identifying facial landmarks, action units and emotions using deep networks

Convolutional Neural Networks (CNN);Facial Landmarks;Expressions;Action Units

Prabhu, Namrata ; Hoiem ; Derek

关键词: Convolutional Neural Networks (CNN);    Facial Landmarks;    Expressions;    Action Units;   

Others  :  https://www.ideals.illinois.edu/bitstream/handle/2142/92967/PRABHU-THESIS-2016.pdf?sequence=1&isAllowed=y

美国|英语

来源: The Illinois Digital Environment for Access to Learning and Scholarship

【 摘 要 】

The goal of this thesis it to use deep neural networks, specifically Convolutional Neural Networks (CNNs) to predict facial landmarks, facial action units and emotions and to study the results of intermediate experiments while doing so. Learning the different features of facial images has always been a difficult task and primarily involves using hand-crafted features which would almost definitely ignore some information related to the different dynamics of facial features. We train our network model using the raw facial images and study its effectiveness in predicting facial landmarks, action units and emotions. In this thesis we learnt that CNNs are highly effective in predicting facial landmarks and AUs, mainly because of their ability to learn features from raw images. We also established that feature sets which can effectively outline the different properties of a face are more useful in classifying facial emotions than either images or facial landmarks.