Partial least squares (PLS) is considered from the perspective of the
Gauss-Markov model. Linear spaces play a fundamental role and, in part
icular, invariant subspaces serve to illuminate the PLS method. Some c
onnections between PCR and PLS are also given.