Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage

Citation
J. Barnard et al., Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage, STAT SINICA, 10(4), 2000, pp. 1281-1311
Citations number
52
Categorie Soggetti
Mathematics
Journal title
STATISTICA SINICA
ISSN journal
10170405 → ACNP
Volume
10
Issue
4
Year of publication
2000
Pages
1281 - 1311
Database
ISI
SICI code
1017-0405(200010)10:4<1281:MCMITO>2.0.ZU;2-W
Abstract
The covariance matrix plays an important role in statistical inference, yet modeling a covariance matrix is often a difficult task in practice due to its dimensionality and the non-negative definite constraint. In order to mo del a covariance matrix effectively it is typically broken down into compon ents based on modeling considerations or mathematical convenience. Decompos itions that have received recent research attention include variance compon ents, spectral decomposition, Cholesky decomposition, and matrix logarithm. In this paper we study a statistically motivated decomposition which appea rs to be relatively unexplored for the purpose of modeling. We model a cova riance matrix in terms of its corresponding standard deviations and correla tion matrix. We discuss two general modeling situations where this approach is useful: shrinkage estimation of regression coefficients, and a general location-scale model for both categorical and continuous variables. We pres ent some simple choices for priors in terms of standard deviations and the correlation matrix, and describe a straightforward computational strategy f or obtaining the posterior of the covariance matrix. We apply our method to real and simulated data sets in the context of shrinkage estimation.