Information bounds for Gibbs samplers

Citation
Pe. Greenwood et al., Information bounds for Gibbs samplers, ANN STATIST, 26(6), 1998, pp. 2128-2156
Citations number
45
Categorie Soggetti
Mathematics
Journal title
ANNALS OF STATISTICS
ISSN journal
00905364 → ACNP
Volume
26
Issue
6
Year of publication
1998
Pages
2128 - 2156
Database
ISI
SICI code
0090-5364(199812)26:6<2128:IBFGS>2.0.ZU;2-K
Abstract
If we wish to estimate efficiently the expectation of an arbitrary function on the basis of the output of a Gibbs sampler, which is better: determinis tic or random sweep? In each case we calculate the asymptotic variance of t he empirical estimator, the average of the function over the output, and de termine the minimal asymptotic variance for estimators that use no informat ion about the underlying distribution. The empirical estimator has noticeab ly smaller variance for deterministic sweep. The variance bound for random sweep is in general smaller than for deterministic sweep, but the two are e qual if the target distribution is continuous. If the components of the tar get distribution are not strongly dependent, the empirical estimator is clo se to efficient under deterministic sweep, and its asymptotic variance appr oximately doubles under random sweep.