Facial UV map completion for pose-invariant face recognition: a novel adversarial approach based on coupled attention residual UNets

Human-centric Computing and Information Sciences

In Seop Na¹  Chung Tran²  Sang Dinh²  Dung Nguyen³ 

[1] Chosun University, 309 Pilmun-daero, 61452, Gwangju, South Korea;Hanoi University of Science and Technology, 1 Dai Co Viet, Hanoi, Vietnam;Vietnam Academy of Science and Technology, 18 Hoang Quoc Viet, Hanoi, Vietnam;

关键词: Generative adversarial networks;    Pose-invariant face recognition;    Deep learning;    AI;   

DOI  :  10.1186/s13673-020-00250-w

来源: Springer

【 摘 要 】

Pose-invariant face recognition refers to the problem of identifying or verifying a person by analyzing face images captured from different poses. This problem is challenging due to the large variation of pose, illumination and facial expression. A promising approach to deal with pose variation is to fulfill incomplete UV maps extracted from in-the-wild faces, then attach the completed UV map to a fitted 3D mesh and finally generate different 2D faces of arbitrary poses. The synthesized faces increase the pose variation for training deep face recognition models and reduce the pose discrepancy during the testing phase. In this paper, we propose a novel generative model called Attention ResCUNet-GAN to improve the UV map completion. We enhance the original UV-GAN by using a couple of U-Nets. Particularly, the skip connections within each U-Net are boosted by attention gates. Meanwhile, the features from two U-Nets are fused with trainable scalar weights. The experiments on the popular benchmarks, including Multi-PIE, LFW, CPLWF and CFP datasets, show that the proposed method yields superior performance compared to other existing methods.

【 授权许可】

CC BY