Stochastic approximation algorithms with constant step size whose average is cooperative

Citation
M. Benaim et Mw. Hirsch, Stochastic approximation algorithms with constant step size whose average is cooperative, ANN APPL PR, 9(1), 1999, pp. 216-241
Citations number
33
Categorie Soggetti
Mathematics
Journal title
ANNALS OF APPLIED PROBABILITY
ISSN journal
10505164 → ACNP
Volume
9
Issue
1
Year of publication
1999
Pages
216 - 241
Database
ISI
SICI code
1050-5164(199902)9:1<216:SAAWCS>2.0.ZU;2-P
Abstract
We consider stochastic approximation algorithms with constant step size who se average ordinary differential equation (ODE) is cooperative and irreduci ble. We show that, under mild conditions on the noise process, invariant me asures and empirical occupations measures of the process weakly converge (a s the time goes to infinity and the step size goes to zero) toward measures which are supported by stable equilibria of the ODE. These results are app lied to analyzing the long-term behavior of a class of learning processes a rising in game theory.