Regression-based facial expression optimization

Hui Yu, Honghai Liu

Research output: Contribution to journalArticlepeer-review

855 Downloads (Pure)


This paper presents an approach for reproducing optimal 3-D facial expressions based on blendshape regression. It aims to improve fidelity of facial expressions but maintain the efficiency of the blendshape method, which is necessary for applications such as human–machine interaction and avatars. Themethod intends to optimize the given facial expression using action units (AUs) based on the facial action coding system recorded from human faces. To
help capture facial movements for the target face, an intermediate model space is generated, where both the target and source AUs have the samemesh topology and vertex number. The optimization is conducted interactively in the intermediate model space through adjusting the regulating parameter. The optimized facial expression model is transferred back to the target facialmodel to produce the final facial expression.We demonstrate that given a sketched facial expression with rough vertex positions indicating the intended
facial expression, the proposed method approaches the sketched facial
expression through automatically selecting blendshapes with corresponding weights. The sketched expression model is finally approximated through AUs representing true muscle movements, which improves the fidelity of facial expressions.
Original languageEnglish
Pages (from-to)386-394
Journal IEEE Transactions on Human-Machine Systems
Issue number3
Early online date14 May 2014
Publication statusPublished - Jun 2014


Dive into the research topics of 'Regression-based facial expression optimization'. Together they form a unique fingerprint.

Cite this