Attribute-Based Synthetic Network (ABS-Net): Learning more from pseudo feature representations

PATTERN RECOGNITION

卷:80

Article

Lu, Jiang^1,2  Li, Jin¹  Yan, Ziang¹  Mei, Fenghua²  Zhang, Changshui¹ 

[1] Tsinghua Univ, Tsinghua Natl Lab Informat Sci & Technol TNList, State Key Lab Intelligent Technol & Syst, Dept Automat, Beijing, Peoples R China

[2] CMDRC, Beijing, Peoples R China

关键词: Pseudo feature representation;    Zero-shot learning;    Supervised learning;    Data augmentation;    Attribute learning;   

DOI  :  10.1016/j.patcog.2018.03.006

来源: Elsevier

【 摘 要 】

In large-scale visual recognition tasks, researchers are usually faced with some challenging problems, such as the extreme imbalance in the number of training data between classes or the lack of annotated data for some classes. In this paper, we propose a novel neural network architecture that automatically synthesizes pseudo feature representations for the classes in lack of annotated images. With the supply of semantic attributes for classes, the proposed Attribute-Based Synthetic Network (ABS-Net) can be applied to zero-shot learning (ZSL) scenario and conventional supervised learning (CSL) scenario as well. For ZSL tasks, the pseudo feature representations can be viewed as annotated feature-level instances for novel concepts, which facilitates the construction of unseen class predictor. For CSL tasks, the pseudo feature representations can be viewed as products of data augmentation on training set, which enriches the interpretation capacity of CSL systems. We demonstrate the effectiveness of the proposed ABS-Net in ZSL and CSL settings on a synthetic colored MNIST dataset (C-MNIST). For several popular ZSL benchmark datasets, our architecture also shows competitive results on zero-shot recognition task, especially leading to tremendous improvement to state-of-the-art mAP on zero-shot retrieval task. (C) 2018 Elsevier Ltd. All rights reserved.

【 授权许可】

Free