Large deviation asymptotics and control variates for simulating large functions

Authors
Citation
P. Meyn Sean, Large deviation asymptotics and control variates for simulating large functions, Annals of applied probability , 16(1), 2006, pp. 310-339
ISSN journal
10505164
Volume
16
Issue
1
Year of publication
2006
Pages
310 - 339
Database
ACNP
SICI code
Abstract
Consider the normalized partial sums of a real-valued function F of a Markov chain, .n:=n.1n.1.k=0F(.(k)),n.1. The chain {.(k):k.0} takes values in a general state space X, with transition kernel P, and it is assumed that the Lyapunov drift condition holds: PV.V.W+bIC where V:X.(0,.), W:X.[1,.) , the set C is small and W dominates F. Under these assumptions, the following conclusions are obtained: 1. It is known that this drift condition is equivalent to the existence of a unique invariant distribution . satisfying .(W)<., and the law of large numbers holds for any function F dominated by W: .n..:=.(F),a.s.,n... 2. The lower error probability defined by P{.n.c} , for c<., n.1, satisfies a large deviation limit theorem when the function F satisfies a monotonicity condition. Under additional minor conditions an exact large deviations expansion is obtained. 3. If W is near-monotone, then control-variates are constructed based on the Lyapunov function V, providing a pair of estimators that together satisfy nontrivial large asymptotics for the lower and upper error probabilities. In an application to simulation of queues it is shown that exact large deviation asymptotics are possible even when the estimator does not satisfy a central limit theorem.