Abstract
Face frontalization is a rising technique for view-invariant face analysis. It enables a non-frontal facial image to recover its general facial appearances to frontal view. A few pioneering works have been proposed very recently. However, face frontalization with detailed facial expression recovering is still very challenging due to the non-linear relationships between head-pose and expression variations. In this paper, we propose a novel facial expression-aware face frontalization method aiming at reconstructing the frontal view while maintaining vivid appearances with regards to facial expressions. First of all, we design multiple face shape models as the reference templates in order to fit in with various shape of facial expressions. Each template describes a set of typical facial actions referred to Facial Action Coding System (FACS). Then a template matching strategy is applied by measuring a weighted Chi Square error such that the input image can be matched with the most approximate template. Finally, Robust Statistical face Frontalization (RSF) method is employed for the task of frontal view recovery. This method is validated on a spontaneous facial expression database and the experimental results show that the proposed method outperforms the state-of-the-art methods.
Original language | English |
---|---|
Title of host publication | LNCS Proceedings of ACCV16 |
Publisher | Springer |
Pages | 375-388 |
Number of pages | 14 |
DOIs | |
Publication status | Early online - 11 Mar 2017 |
Event | ACCV2016 - Taipei International Conference Center, Taipei, Taiwan, Province of China Duration: 20 Nov 2016 → 24 Nov 2016 http://www.accv2016.org/ |
Publication series
Name | Lecture Notes in Computer Science |
---|---|
ISSN (Print) | 0302-9743 |
Conference
Conference | ACCV2016 |
---|---|
Country/Territory | Taiwan, Province of China |
City | Taipei |
Period | 20/11/16 → 24/11/16 |
Internet address |
Keywords
- RCUK
- EPSRC
- EP/N025849/1
Fingerprint
Dive into the research topics of 'Facial expression-aware face frontalization'. Together they form a unique fingerprint.Press/Media
-
'Robot therapist' that teaches children on the autistic spectrum how to take turns and hold conversations.
26/06/17 → 5/07/17
4 items of Media coverage
Press/Media: Research cited