Berger, Erich, An almost sure invariance principle for stochastic approximation procedures in linear filtering theory, Annals of applied probability , 7(2), 1997, pp. 444-459
In this paper we consider a class of stochastic approximation procedures that arises in linear filtering and regression theory. Our main result asserts that the stochastic approximation process satisfies an almost sure invariance principle (with a certain rate of convergence) if the partial sums of the errors do.