Facial expression transfer method based on frequency analysis

PATTERN RECOGNITION

卷:49

Article

Wei, Wei¹  Tian, Chunna³  Maybank, Stephen John⁴  Zhang, Yanning² 

[1] Northwestern Polytech Univ, Sch Comp Sci, Shaanxi Prov Key Lab Speech & Image Informat Proc, Xian 710129, Peoples R China

[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710129, Peoples R China

[3] Xidian Univ, Sch Elect Engn, VIPS Lab, Xian, Peoples R China

[4] Univ London, Birkbeck Coll, Dept Comp Sci & Informat Syst, London WC1E 7HU, England

关键词: Expression transfer;    Warping technique;    Facial feature location;    Frequency domain analysis;   

DOI  :  10.1016/j.patcog.2015.08.004

来源: Elsevier

【 摘 要 】

We propose a novel expression transfer method based on an analysis of the frequency of multi-expression facial images. We locate the facial features automatically and describe the shape deformations between a neutral expression and non-neutral expressions. The subtle expression changes are important visual clues to distinguish different expressions. These changes are more salient in the frequency domain than in the image domain. We extract the subtle local expression deformations for the source subject, coded in the wavelet decomposition. This information about expressions is transferred to a target subject. The resulting synthesized image preserves both the facial appearance of the target subject and the expression details of the source subject. This method is extended to dynamic expression transfer to allow a more precise interpretation of facial expressions. Experiments on Japanese Female Facial Expression (JAFFE), the extended Cohn-Kanade (CK+) and PIE facial expression databases show the superiority of our method over the state-of-the-art methods. (C) 2015 Elsevier Ltd. All rights reserved.

【 授权许可】

Free