A New Machine Learning Algorithm Based on Optimization Method for Regression and Classification Problems

Mathematics

Suthep Suantai¹  Warunun Inthakon¹  Dawan Chumpungam¹  Panitarn Sarnmeta¹ 

[1] Data Science Research Center, Department of Mathematics, Faculty of Science, Chiang Mai University, Chiang Mai 50200, Thailand;

关键词: Hilbert space;    convex minimization problem;    machine learning;    forward–backward algorithm;   

DOI  :  10.3390/math8061007

来源: DOAJ

【 摘 要 】

A convex minimization problem in the form of the sum of two proper lower-semicontinuous convex functions has received much attention from the community of optimization due to its broad applications to many disciplines, such as machine learning, regression and classification problems, image and signal processing, compressed sensing and optimal control. Many methods have been proposed to solve such problems but most of them take advantage of Lipschitz continuous assumption on the derivative of one function from the sum of them. In this work, we introduce a new accelerated algorithm for solving the mentioned convex minimization problem by using a linesearch technique together with a viscosity inertial forward–backward algorithm (VIFBA). A strong convergence result of the proposed method is obtained under some control conditions. As applications, we apply our proposed method to solve regression and classification problems by using an extreme learning machine model. Moreover, we show that our proposed algorithm has more efficiency and better convergence behavior than some algorithms mentioned in the literature.

【 授权许可】

Unknown