ETALON IMAGES: UNDERSTANDING THE CONVOLUTION NEURAL NETWORKS

International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences

Molchanov, V. V.^1¹ 

[1] FGUP «State Research Institute of Aviation Systems», 125319, Moscow, Viktorenko street, 7, Russia^1

关键词: CNN;    deep learning;    manifold learning;    affine transformations;    graphs;    etalons;   

DOI  :  10.5194/isprs-archives-XLII-2-707-2018

学科分类：地球科学(综合)

来源: Copernicus Publications

【 摘 要 】

In this paper we propose a new technic called etalons, which allows us to interpret the way how convolution network makes its predictions. This mechanism is very similar to voting among different experts. Thereby CNN could be interpreted as a variety of experts, but it acts not like a sum or product of them, but rather represent a complicated hierarchy. We implement algorithm for etalon acquisition based on well-known properties of affine maps. We show that neural net has two high-level mechanisms of voting: first, based on attention to input image regions, specific to current input, and second, based on ignoring specific input regions. We also make an assumption that there is a connection between complexity of the underlying data manifold and the number of etalon images and their quality.

【 授权许可】

CC BY