THE SEMIPARAMETRIC BERNSTEIN-VON MISES THEOREM

Citation
P. J. Bickel et B. J. K. Kleijn, THE SEMIPARAMETRIC BERNSTEIN-VON MISES THEOREM, Annals of statistics , 40(1), 2012, pp. 206-237
Journal title
ISSN journal
00905364
Volume
40
Issue
1
Year of publication
2012
Pages
206 - 237
Database
ACNP
SICI code
Abstract
In a smooth semiparametric estimation problem, the marginal posterior for the parameter of interest is expected to be asymptotically normal and satisfy frequentist criteria of optimality if the model is endowed with a suitable prior. It is shown that, under certain straightforward and interprétable conditions, the assertion of Le Cam's acclaimed, but strictly parametric, Bernsteinvon Mises theorem [Univ. California Publ. Statist. 1 (1953) 277-329] holds in the semiparametric situation as well. As a consequence, Bayesian pointestimators achieve efficiency, for example, in the sense of Hajek's convolution theorem [Z. Wahrsch. Verw. Gebiete 14 (1970) 323-330]. The model is required to satisfy differentiability and metric entropy conditions, while the nuisance prior must assign nonzero mass to certain Kullback-Leibler neighborhoods [Ghosal, Ghosh and van der Vaart Ann. Statist. 28 (2000) 500-531]. In addition, the marginal posterior is required to converge at parametric rate, which appears to be the most stringent condition in examples. The results are applied to estimation of the linear coefficient in partial linear regression, with a Gaussian prior on a smoothness class for the nuisance.