Deep, dense and accurate 3D face correspondence for generating population specific deformable models

Syed Zulqarnain Gilani, Ajmal Mian, Peter Eastwood

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)

Abstract

We present a multilinear algorithm to automatically establish dense point-to-point correspondence over an arbitrarily large number of population specific 3D faces across identities, facial expressions and poses. The algorithm is initialized with a subset of anthropometric landmarks detected by our proposed Deep Landmark Identification Network which is trained on synthetic images. The landmarks are used to segment the 3D face into Voronoi regions by evolving geodesic level set curves. Exploiting the intrinsic features of these regions, we extract discriminative keypoints on the facial manifold to elastically match the regions across faces for establishing dense correspondence. Finally, we generate a Region based 3D Deformable Model which is fitted to unseen faces to transfer the correspondences. We evaluate our algorithm on the tasks of facial landmark detection and recognition using two benchmark datasets. Comparison with thirteen state-of-the-art techniques shows the efficacy of our algorithm.

Original languageEnglish
Pages (from-to)238-250
Number of pages13
JournalPattern Recognition
Volume69
DOIs
Publication statusPublished - Sep 2017
Externally publishedYes

Keywords

  • 3D face morphing
  • Deep learning
  • Dense 3D face correspondence
  • Face recognition
  • Keypoint detection
  • Landmark identification
  • Shape descriptor

Fingerprint Dive into the research topics of 'Deep, dense and accurate 3D face correspondence for generating population specific deformable models'. Together they form a unique fingerprint.

Cite this