Stochastic control problems where small intervention costs have big effects

Authors
Citation
B. Oksendal, Stochastic control problems where small intervention costs have big effects, APPL MATH O, 40(3), 1999, pp. 355-375
Citations number
16
Categorie Soggetti
Mathematics
Journal title
APPLIED MATHEMATICS AND OPTIMIZATION
ISSN journal
00954616 → ACNP
Volume
40
Issue
3
Year of publication
1999
Pages
355 - 375
Database
ISI
SICI code
0095-4616(199911/12)40:3<355:SCPWSI>2.0.ZU;2-1
Abstract
We study an impulse control problem where the cost of interfering in a stoc hastic system with an impulse of size zeta is an element of R is given by c + lambda\zeta\, where c and lambda are positive constants. We call lambda the proportional cost coefficient and c the intervention cost. We find the value/cost functi on V-c for this problem for each c > 0 and we show that lim(c-->0+) V-c = W , where W is the value function far the corresponding singular stochastic c ontrol problem. Our main result is that dV(c)/dc = infinity at c = 0. This illustrates that the introduction of an intervention cost c > 0, howev er small, into a system can have a big effect on the value function: the in crease in the value function is in no proportion to the increase in c (from c = 0).