ForkNet: Strong Semantic Feature Representation and Subregion Supervision for Accurate Remote Sensing Change Detection

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Mingchao Li¹  Yerui Chen¹  Haoming He¹  Qiang Chen¹ 

[1] School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China;

关键词: Feature pyramid network (FPN);    pyramid Tversky loss;    remote sensing change detection (RSCD);    siamese network;   

DOI  :  10.1109/JSTARS.2022.3152775

来源: DOAJ

【 摘 要 】

In this article, we propose an effective siamese feature pyramid network (FPN), ForkNet, for remote sensing change detection (RSCD). We find that the siamese network structure, which is widely used for RSCD, contains only one downsampling network in the feature extraction stage, e.g., VGG16 and ResNet-18, to extract the deep features of a single image, such that the features have a large semantic gap between high-level feature maps and low-level feature maps. The low-level feature maps with weak semantics may become a bottleneck of network performance. Thus, we apply an FPN to the feature extraction stage to generate feature representations with strong semantics at each level. Further, we design a cross-resolution attention module (CRAM) to aggregate contextual information across resolutions and naturally serve as a bridge for exchanging information across different resolution feature maps. The siamese FPN equipped with the CRAM is called ForkNet. To better train ForkNet, we extend the Tversky loss to a novel loss, pyramid Tversky loss, which is capable of supervising subregions at different scales to obtain more fine-grained detection results. Using pyramid Tversky loss together with Focal loss, our ForkNet achieves state-of-the-art detection performance on two challenging datasets.

【 授权许可】

Unknown