When Inaccuracies in Value Functions Do Not Propagate on Optima and Equilibria

Mathematics

Agnieszka Wiszniewska-Matyszkiel¹  Rajani Singh¹ 

[1] Institute of Applied Mathematics and Mechanics, Faculty of Mathematics, Informatics and Mechanics, University of Warsaw, 02-097 Warsaw, Poland;

关键词: optimal control;    dynamic programming;    Bellman equation;    dynamic games;    Nash equilibria;    Pareto optimality;   

DOI  :  10.3390/math8071109

来源: DOAJ

【 摘 要 】

We study general classes of discrete time dynamic optimization problems and dynamic games with feedback controls. In such problems, the solution is usually found by using the Bellman or Hamilton–Jacobi–Bellman equation for the value function in the case of dynamic optimization and a set of such coupled equations for dynamic games, which is not always possible accurately. We derive general rules stating what kind of errors in the calculation or computation of the value function do not result in errors in calculation or computation of an optimal control or a Nash equilibrium along the corresponding trajectory. This general result concerns not only errors resulting from using numerical methods but also errors resulting from some preliminary assumptions related to replacing the actual value functions by some a priori assumed constraints for them on certain subsets. We illustrate the results by a motivating example of the Fish Wars, with singularities in payoffs.

【 授权许可】

Unknown