In this paper Kolmogorov's work in mathematical statistics is reviewed. The main areas under discussion are: the idea of sufficiency, linear models and unbiased estimators. The relationship of Kolmogorov's contributions with modern statistical theory, in particular, with Bayesian analysis, is analyzed.