Texture and shape information fusion for facial expression and facial action unit recognition

Article


Kotsia, I., Zafeiriou, S. and Pitas, I. 2008. Texture and shape information fusion for facial expression and facial action unit recognition. Pattern Recognition. 41 (3), pp. 833-851. https://doi.org/10.1016/j.patcog.2007.06.026
TypeArticle
TitleTexture and shape information fusion for facial expression and facial action unit recognition
AuthorsKotsia, I., Zafeiriou, S. and Pitas, I.
Abstract

A novel method based on fusion of texture and shape information is proposed for facial expression and Facial Action Unit (FAU) recognition from video sequences. Regarding facial expression recognition, a subspace method based on Discriminant Non-negative Matrix Factorization (DNMF) is applied to the images, thus extracting the texture information. In order to extract the shape information, the system firstly extracts the deformed Candide facial grid that corresponds to the facial expression depicted in the video sequence. A Support Vector Machine (SVM) system designed on an Euclidean space, defined over a novel metric between grids, is used for the classification of the shape information. Regarding FAU recognition, the texture extraction method (DNMF) is applied on the differences images of the video sequence, calculated taking under consideration the neutral and the expressive frame. An SVM system is used for FAU classification from the shape information. This time, the shape information consists of the grid node coordinate displacements between the neutral and the expressed facial expression frame. The fusion of texture and shape information is performed using various approaches, among which are SVMs and Median Radial Basis Functions (MRBFs), in order to detect the facial expression and the set of present FAUs. The accuracy achieved using the Cohn-Kanade database is 92.3% when recognizing the seven basic facial expressions (anger, disgust, fear, happiness, sadness, surprise and neutral), and 92.1% when recognizing the 17 FAUs that are responsible for facial expression development.

KeywordsFacial expression recognition; facial action unit recognition; discriminant non-negative matrix factorization; multidimensional embedding; support vector machines; radial basis functions; fusion
Research GroupResearch Group on Development of Intelligent Environments
PublisherElsevier Science
JournalPattern Recognition
ISSN0031-3203
Publication process dates
Deposited26 Nov 2012
Output statusPublished
Digital Object Identifier (DOI)https://doi.org/10.1016/j.patcog.2007.06.026
LanguageEnglish
Permalink -

https://repository.mdx.ac.uk/item/83wv5

  • 16
    total views
  • 0
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as