Multidimensional mutual ordering of patterns using a set of pre-trained artificial neural networks

International Conference on Information Technologies in Business and Industry 2016

计算机科学;经济学;工业技术

Kulagin, V.P.^1 ; Ivanov, A.I.^2 ; Kuznetsov, Yu.M.^1 ; Chulkova, G.M.^1

National Research University, Higher School of Economics, 20, Myasnitskaya str., Moscow

101000, Russia^1

Penza Research Electrotechnical Institute, 9, Sovetskaya str., Penza

440000, Russia^2

关键词: Entropy measure;    Global minima;    Handwritten texts;    Multi dimensional;   

Others  :  https://iopscience.iop.org/article/10.1088/1742-6596/803/1/012083/pdf
DOI  :  10.1088/1742-6596/803/1/012083

来源: IOP

【 摘 要 】

The article shows that large artificial neural networks can be used for mutual ordering of a set of multi-dimensional patterns of the same nature (handwritten text, voice, smells, taste). Each neural network must be pre-trained to recognize one of the patterns. As a measure of ordering one can use the entropy of patterns "Strangers" that are input to a neural network trained to recognize only examples of the pattern "familiar". The neural network after training reduces the entropy of the examples of the pattern "Familiar" and increases the entropy of examples of pattern "Stranger." It is shown that the entropy measure of the ordering always has two global minima. The first minimum corresponds to the pattern "Familiar", the second to the inversion of the pattern "Familiar". It is also shown that the Hamming distance between the patterns belonging to two different groups (groups of the two global minima) is always as large as possible.