A framework for automatic and perceptually valid facial expression generation

Hui Yu, Oliver Garrod, Rachael Jack, Philippe Schyns

Research output: Contribution to journalArticlepeer-review

193 Downloads (Pure)

Abstract

Facial expressions are facial movements reflecting the internal emotional states of a character or in response to social communications. Realistic facial animation should consider at least two factors: believable visual effect and valid facial movements. However, most research tends to separate these two issues. In this paper, we present a framework for generating 3D facial expressions considering both the visual the dynamics effect. A facial expression mapping approach based on local geometry encoding is proposed, which encodes deformation in the 1-ring vector. This method is capable of mapping subtle facial movements without considering those shape and topological constraints. Facial expression mapping is achieved through three steps: correspondence establishment, deviation transfer and movement mapping. Deviation is transferred to the conformal face space through minimizing the error function. This function is formed by the source neutral and the deformed face model related by those transformation matrices in 1-ring neighborhood. The transformation matrix in 1-ring neighborhood is independent of the face shape and the mesh topology. After the facial expression mapping, dynamic parameters are then integrated with facial expressions for generating valid facial expressions. The dynamic parameters were generated based on psychophysical methods. The efficiency and effectiveness of the proposed methods have been tested using various face models with different shapes and topological representations.
Original languageEnglish
Pages (from-to)9427-9447
JournalMultimedia Tools and Applications
Volume74
Issue number21
Early online date12 Jun 2014
DOIs
Publication statusPublished - Nov 2015

Keywords

  • Communication Networks
  • Information Systems and Applications
  • Security and Cryptology

Fingerprint

Dive into the research topics of 'A framework for automatic and perceptually valid facial expression generation'. Together they form a unique fingerprint.

Cite this