Convergence with probability one of stochastic approximation algorithms whose average is cooperative

Authors
Citation
M. Benaim, Convergence with probability one of stochastic approximation algorithms whose average is cooperative, NONLINEARIT, 13(3), 2000, pp. 601-616
Citations number
24
Categorie Soggetti
Mathematics
Journal title
NONLINEARITY
ISSN journal
09517715 → ACNP
Volume
13
Issue
3
Year of publication
2000
Pages
601 - 616
Database
ISI
SICI code
0951-7715(200005)13:3<601:CWPOOS>2.0.ZU;2-I
Abstract
We consider a stochastic approximation process Xn+1 - x(n) = Yn+1 (F(x(n)) + Un+1) where F : R-m --> R-m is a C-2 irreducible cooperative dissipative vector f ield, {y(n)}(n greater than or equal to 0) is a sequence of positive number s decreasing to 0 and {U-n}(n greater than or equal to 0) a sequence of uni formly bounded R-m martingale differences. We show that under certain condi tions on {y(n)} and {U-n} the sequence {x(n)}(n greater than or equal to 0) converges with probability one toward the equilibria set of the vector fie ld F.