An Online Saddle Point optimization algorithm with Regularization

2019 2nd International Conference on Advanced Materials, Intelligent Manufacturing and Automation

Xu, Yue^1 ; Jiang, Ying^1 ; Xie, Xin^2 ; Li, Dequan^1

School of Mathematics and Big Data, Anhui University of Science and Technology, Huainan, Anhui

232001, China^1

School of Mathematics and Statistics, Huangshan University, Huangshan, Anhui

245041, China^2

关键词: Decision variables;    Follow the leaders;    Nash equilibria;    Optimal decision making;    Optimal decisions;    Optimization algorithms;    Payoff function;    Regularization terms;   

Others  :  https://iopscience.iop.org/article/10.1088/1757-899X/569/5/052035/pdf
DOI  :  10.1088/1757-899X/569/5/052035

来源: IOP

【 摘 要 】

This paper presents an online saddle-point optimization algorithm (OSP) to solve the optimal decision-making problem in economic games. In this setting, the two mutual competing players choose a pair of optimal decisions (Nash equilibrium) at each iteration. Firstly, the Follow the Leader (FTL) algorithm is proposed to update the decisions, and the regularization term is added to stabilize the Nash equilibrium for both players. Secondly, the saddle-point regret (SP-Regret) is used to measure the gap between the cumulative payoffs and the saddle point value of the aggregate payoff functions. To this end, this paper aims to minimize it. Finally, the simulation results show that, under the proposed OSP algorithm, the SP-Regret can still be sublinear with regularization and the decision variables of both players can be constrained to fluctuate within a certain range by adding regularization, which can effectively make the Nash equilibrium stable.