Multi-subspace supervised descent method for robust face alignment

Jianwen Lou, Xiaoxu Cai, Yiming Wang, Hui Yu

    Research output: Contribution to journalArticlepeer-review

    101 Downloads (Pure)

    Abstract

    Supervised Descent Method (SDM) is one of the leading cascaded regression approaches for face alignment with state-of-the-art performance and a solid theoretical basis. However, SDM is prone to local optima and likely averages conflicting descent directions. This makes SDM ineffective in covering a complex facial shape space due to large head poses and rich non-rigid face deformations. In this paper, a novel two-step framework called multi-subspace SDM (MS-SDM) is proposed to equip SDM with a stronger capability for dealing with unconstrained faces. The optimization space is first partitioned with regard to shape variations using k-means. The generated subspaces show semantic significance which highly correlates with head poses. Faces among a certain subspace also show compatible shape-appearance relationships. Then, Naive Bayes is applied to conduct robust subspace prediction by concerning about the relative proximity of each subspace to the sample. This guarantees that each sample can be allocated to the most appropriate subspace-specific regressor. The proposed method is validated on benchmark face datasets with a mobile facial tracking implementation.
    Original languageEnglish
    Pages (from-to)35455-35469
    Number of pages15
    JournalMultimedia Tools and Applications
    Volume78
    Issue number24
    Early online date4 Sept 2019
    DOIs
    Publication statusPublished - 1 Dec 2019

    Keywords

    • RCUK
    • EPSRC
    • EP/N025849/1

    Fingerprint

    Dive into the research topics of 'Multi-subspace supervised descent method for robust face alignment'. Together they form a unique fingerprint.

    Cite this