Tail Events of some Nonhomogeneous Markov Chains

Citation
Niemiro, Wojciech et Pokarowski, Piotr, Tail Events of some Nonhomogeneous Markov Chains, Annals of applied probability , 5(1), 1995, pp. 261-293
ISSN journal
10505164
Volume
5
Issue
1
Year of publication
1995
Pages
261 - 293
Database
ACNP
SICI code
Abstract
We consider finite state nonhomogeneous Markov chains with one-step transition probabilities roughly proportional to powers of a small parameter, converging to zero. We examine asymptotic properties of trajectories. The analysis is based on the so-called orders of recurrence. Transient states, recurrent classes and periodic subclasses can be identified in terms of the matrix of powers. This leads to a complete description of the tail sigma field. Our theorems generalize the classical results for homogeneous chains and can also be applied to chains generated by stochastic algorithms of the "simulated annealing" type.