Robust Online Learning Method Based on Dynamical Linear Quadratic Regulator

IEEE Access

Xingjian Jing¹  Tianhai Tian²  Hanwen Ning³  Jiaming Zhang³ 

[1] Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong;School of Mathematics, Monash University, Melbourne, VIC, Australia;School of Statistics and Mathematics, Zhongnan University of Economics and Law, Wuhan, China;

关键词: Online machine learning;    optimal control;    linear quadratic regulator;    complex noise disturbances;   

DOI  :  10.1109/ACCESS.2019.2936537

来源: DOAJ

【 摘 要 】

In this paper, a novel algorithm is proposed for inferring online learning tasks efficiently. By a carefully designed scheme, the online learning problem is first formulated as a state feedback control problem for a series of finite-dimensional systems. Then, the online linear quadratic regulator (OLQR) learning algorithm is developed to obtain the optimal parameter updating. Solid mathematical analysis on the convergence and rationality of our method is also provided. Compared with the conventional learning methods, our learning framework represents a completely different approach with optimal control techniques, but does not introduce any assumption on the characteristics of noise or learning rate. The proposed method not only guarantees the fast and robust convergence but also achieves better performance in learning efficiency and accuracy, especially for the data streams with complex noise disturbances. In addition, under the proposed framework, new robust algorithms can be potentially developed for various machine learning tasks by using the powerful optimal control techniques. Numerical results on benchmark datasets and practical applications confirm the advantages of our new method.

【 授权许可】

Unknown