Adaptive entropy-based learning with dynamic artificial neural network

NEUROCOMPUTING

卷:338

Article

Pinto, Tiago¹  Morais, Hugo²  Manuel Corchado, Juan¹ 

[1] Univ Salamanca, BISITE Res Ctr, Calle Espejo 12, Salamanca 37007, Spain

[2] Tech Univ Denmark DTU, Dept Elect Engn, AUTomat & Control Grp, Bldg 326, DK-2800 Lyngby, Denmark

关键词: Artificial Neural Networks;    Electricity market prices;    Entropy;    Forecasting;    Information theory;    Machine learning;   

DOI  :  10.1016/j.neucom.2018.09.092

来源: Elsevier

【 摘 要 】

Entropy models the added information associated to data uncertainty, proving that stochasticity is not purely random. This paper explores the potential improvement of machine learning methodologies through the incorporation of entropy analysis in the learning process. A multi-layer perceptron is applied to identify patterns in previous forecasting errors achieved by a machine learning methodology. The proposed learning approach is adaptive to the training data through a re-training process that includes only the most recent and relevant data, thus excluding misleading information from the training process. The learnt error patterns are then combined with the original forecasting results in order to improve forecasting accuracy, using the Renyi entropy to determine the amount in which the original forecasted value should be adapted considering the learnt error patterns. The proposed approach is combined with eleven different machine learning methodologies, and applied to the forecasting of electricity market prices using real data from the Iberian electricity market operator - OMIE. Results show that through the identification of patterns in the forecasting error, the proposed methodology is able to improve the learning algorithms' forecasting accuracy and reduce the variability of their forecasting errors. (C) 2019 Elsevier B.V. All rights reserved.

【 授权许可】

Free