Asymptotic behavior of the value functions of discrete-time discounted optimal control

Authors
Citation
F. Wirth, Asymptotic behavior of the value functions of discrete-time discounted optimal control, J OPTIM TH, 110(1), 2001, pp. 183-210
Citations number
21
Categorie Soggetti
Engineering Mathematics
Journal title
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS
ISSN journal
00223239 → ACNP
Volume
110
Issue
1
Year of publication
2001
Pages
183 - 210
Database
ISI
SICI code
0022-3239(200107)110:1<183:ABOTVF>2.0.ZU;2-2
Abstract
We study deterministic discounted optimal control problems associated with discrete-time systems. It is shown that, for small discount rates, the cont rollability properties of the underlying system can guarantee the convergen ce of the discounted value function to the value function of the average yi eld. An application in the theory of exponential growth rates of discrete i nclusions is presented. This application motivates the analysis of infinite -horizon optimal control problems with running yields that are unbounded fr om below.