Texture and shape information fusion for facial expression and facial action unit recognition
Article
Kotsia, I., Zafeiriou, S. and Pitas, I. 2008. Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recognition. 41 (3), pp. 833-851. https://doi.org/10.1016/j.patcog.2007.06.026
Type | Article |
---|---|
Title | Texture and shape information fusion for facial expression and facial action unit recognition |
Authors | Kotsia, I., Zafeiriou, S. and Pitas, I. |
Abstract | A novel method based on fusion of texture and shape information is proposed for facial expression and Facial Action Unit (FAU) recognition from video sequences. Regarding facial expression recognition, a subspace method based on Discriminant Non-negative Matrix Factorization (DNMF) is applied to the images, thus extracting the texture information. In order to extract the shape information, the system firstly extracts the deformed Candide facial grid that corresponds to the facial expression depicted in the video sequence. A Support Vector Machine (SVM) system designed on an Euclidean space, defined over a novel metric between grids, is used for the classification of the shape information. Regarding FAU recognition, the texture extraction method (DNMF) is applied on the differences images of the video sequence, calculated taking under consideration the neutral and the expressive frame. An SVM system is used for FAU classification from the shape information. This time, the shape information consists of the grid node coordinate displacements between the neutral and the expressed facial expression frame. The fusion of texture and shape information is performed using various approaches, among which are SVMs and Median Radial Basis Functions (MRBFs), in order to detect the facial expression and the set of present FAUs. The accuracy achieved using the Cohn-Kanade database is 92.3% when recognizing the seven basic facial expressions (anger, disgust, fear, happiness, sadness, surprise and neutral), and 92.1% when recognizing the 17 FAUs that are responsible for facial expression development. |
Keywords | Facial expression recognition; facial action unit recognition; discriminant non-negative matrix factorization; multidimensional embedding; support vector machines; radial basis functions; fusion |
Research Group | Research Group on Development of Intelligent Environments |
Publisher | Elsevier Science |
Journal | Pattern Recognition |
ISSN | 0031-3203 |
Publication process dates | |
Deposited | 26 Nov 2012 |
Output status | Published |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.patcog.2007.06.026 |
Language | English |
https://repository.mdx.ac.uk/item/83wv5
16
total views0
total downloads0
views this month0
downloads this month