Competitive regularised regression

NEUROCOMPUTING

卷:390

Article

Jamil, Waqas¹  Bouchachia, Abdelhamid¹ 

[1] Bournemouth Univ, Dept Comp & Informat, Poole, Dorset, England

关键词: Regression;    Regularisation;    Online learning;    Competitive analysis;   

DOI  :  10.1016/j.neucom.2019.08.094

来源: Elsevier

【 摘 要 】

Regularised regression uses sparsity and variance to reduce the complexity and over-fitting of a regression model. The present paper introduces two novel regularised linear regression algorithms: Competitive Iterative Ridge Regression (CIRR) and Online Shrinkage via Limit of Gibbs Sampler (OSLOG) for fast and reliable prediction on Big Data without making distributional assumption on the data. We use the technique of competitive analysis to design them and show their strong theoretical guarantee. Furthermore, we compare their performance against some neoteric regularised regression methods such as Online Ridge Regression (ORR) and the Aggregating Algorithm for Regression (AAR). The comparison of the algorithms is done theoretically, focusing on the guarantee on the performance on cumulative loss, and empirically to show the advantages of CIRR and OSLOG. (C) 2019 Published by Elsevier B.V.

【 授权许可】

Free