Spatial reasoning for few-shot object detection

PATTERN RECOGNITION

卷:120

Article

Kim, Geonuk¹  Jung, Hong-Gyu¹  Lee, Seong-Whan^1,2 

[1] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea

[2] Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea

关键词: Few-shot learning;    Object detection;    Transfer learning;    Visual reasoning;    Data augmentation;   

DOI  :  10.1016/j.patcog.2021.108118

来源: Elsevier

【 摘 要 】

Although modern object detectors rely heavily on a significant amount of training data, humans can eas-ily detect novel objects using a few training examples. The mechanism of the human visual system is to interpret spatial relationships among various objects and this process enables us to exploit contextual information by considering the co-occurrence of objects. Thus, we propose a spatial reasoning framework that detects novel objects with only a few training examples in a context. We infer geometric related-ness between novel and base RoIs (Region-of-Interests) to enhance the feature representation of novel categories using an object detector well trained on base categories. We employ a graph convolutional network as the RoIs and their relatedness are defined as nodes and edges, respectively. Furthermore, we present spatial data augmentation to overcome the few-shot environment where all objects and bounding boxes in an image are resized randomly. Using the PASCAL VOC and MS COCO datasets, we demonstrate that the proposed method significantly outperforms the state-of-the-art methods and verify its efficacy through extensive ablation studies. (c) 2021 Elsevier Ltd. All rights reserved.

【 授权许可】

Free