Robust statistical frontalization of human and animal faces


Sagonas, C., Panagakis, Y., Zafeiriou, S. and Pantic, M. 2017. Robust statistical frontalization of human and animal faces. International Journal of Computer Vision. 122 (2), pp. 270-291.
TitleRobust statistical frontalization of human and animal faces
AuthorsSagonas, C., Panagakis, Y., Zafeiriou, S. and Pantic, M.

The unconstrained acquisition of facial data in real-world conditions may result in face images with significant pose variations, illumination changes, and occlusions, affecting the performance of facial landmark localization and recognition methods. In this paper, a novel method, robust to pose, illumination variations, and occlusions is proposed for joint face frontalization and landmark localization. Unlike the state-of-the-art methods for landmark localization and pose correction, where large amount of manually annotated images or 3D facial models are required, the proposed method relies on a small set of frontal images only. By observing that the frontal facial image of both humans and animals, is the one having the minimum rank of all different poses, a model which is able to jointly recover the frontalized version of the face as well as the facial landmarks is devised. To this end, a suitable optimization problem is solved, concerning minimization of the nuclear norm (convex surrogate of the rank function) and the matrix ℓ1 norm accounting for occlusions. The proposed method is assessed in frontal view reconstruction of human and animal faces, landmark localization, pose-invariant face recognition, face verification in unconstrained conditions, and video inpainting by conducting experiment on 9 databases. The experimental results demonstrate the effectiveness of the proposed method in comparison to the state-of-the-art methods for the target problems.

JournalInternational Journal of Computer Vision
Publication dates
Print01 Apr 2017
Online20 Jul 2016
Publication process dates
Deposited06 Mar 2018
Accepted26 May 2016
Output statusPublished
Publisher's version
Digital Object Identifier (DOI)
Permalink -

Download files

Publisher's version
  • 8
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as