REDUCED SPACE OPTIMAL ANALYSIS FOR HISTORICAL DATA SETS - 136 YEARS OF ATLANTIC SEA-SURFACE TEMPERATURES

A computationally efficient method for analyzing meteorological and oc eanographic historical data sets has been developed. The method combin es data reduction and least squares optimal estimation. The data reduc tion involves computing empirical orthogonal functions (EOFs) of the d ata based on their recent, high-quality portion and using a leading; E OF subset as a basis for the analyzed solution and for fitting a first -order linear model of time transitions. We then formulate optimal est imation problems in terms of the EOF projection of the analyzed field to obtain reduced space analogues of the optimal smoother, the Kalman filter, and optimal interpolation techniques. All reduced space algori thms are far cheaper computationally than their full grid prototypes, while their solutions are not necessarily inferior since the sparsity and error in available data often make estimation of small-scale featu res meaningless. Where covariance patterns can be estimated from the a vailable data, the analysis methods fill gaps, correct sampling errors , and produce spatially and temporally coherent analyzed data sets. il s with classical least squares estimation, the reduced space versions also provide theoretical error estimates for analyzed values. The meth ods are demonstrated on Atlantic monthly sea surface temperature (SST) anomalies for 1856-1991 from the United Kingdom Meteorological Office historical sea surface temperature data set (version MOHSST5). Choice of a reduced space dimension of 30 is shown to be adequate. The analy ses are tested by withholding a significant part of the data and prove to be robust and in agreement with their own error estimates; they ar e also consistent with a partially independent optimal interpolation ( OI) analysis by Reynolds and Smith [1994] produced in the National Cen ters for Environmental Prediction (NCEP) (known as the NCEP OI analysi s). A simple statistical model is used to depict the month-to-month SS T evolution in the optimal smoother algorithm. Results are somewhat su perior to both the Kalman filter, which relies less on the model, and the optimal interpolation, which does not use it at all. The method ge neralizes a few recent works on using a reduced space for data set ana lyses. Difficulties of methods which simply fit EOF patterns to observ ed data are pointed out, and the more complete analysis procedures dev eloped here are suggested as a remedy.