Stability of piecewise-deterministic Markov processes

Citation
F. Dufour et Olv. Costa, Stability of piecewise-deterministic Markov processes, SIAM J CON, 37(5), 1999, pp. 1483-1502
Citations number
18
Categorie Soggetti
Mathematics,"Engineering Mathematics
Journal title
SIAM JOURNAL ON CONTROL AND OPTIMIZATION
ISSN journal
03630129 → ACNP
Volume
37
Issue
5
Year of publication
1999
Pages
1483 - 1502
Database
ISI
SICI code
0363-0129(19990810)37:5<1483:SOPMP>2.0.ZU;2-A
Abstract
In this paper, we study a form of stability for a general family of nondiff usion Markov processes known in the literature as piecewise-deterministic M arkov process (PDMP). By stability here we mean the existence of an invaria nt probability measure for the PDMP. It is shown that the existence of such an invariant probability measure is equivalent to the existence of a sigma -finite invariant measure for a Markov kernel G linked to the resolvent ope rator U of the PDMP, satisfying a boundedness condition or, equivalently, a Radon-Nikodym derivative. Here we generalize existing results of the liter ature [O. Costa, J. Appl. Prob., 27, (1990), pp. 60-73; M. Davis, Markov Mo dels and Optimization, Chapman and Hall, 1993] since we do not require any additional assumptions to establish this equivalence. Moreover, we give suf ficient conditions to ensure the existence of such a sigma-finite measure s atisfying the boundedness condition. They are mainly based on a modified Fo ster-Lyapunov criterion for the case in which the Markov chain generated by G is either recurrent or weak Feller. To emphasize the relevance of our re sults, we study three examples and in particular, we are able to generalize the results obtained by Costa and Davis on the capacity expansion model.