Regularization networks: Fast weight calculation via Kalman filtering

Citation
G. De Nicolao et G. Ferrari-trecate, Regularization networks: Fast weight calculation via Kalman filtering, IEEE NEURAL, 12(2), 2001, pp. 228-235
Citations number
27
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
IEEE TRANSACTIONS ON NEURAL NETWORKS
ISSN journal
10459227 → ACNP
Volume
12
Issue
2
Year of publication
2001
Pages
228 - 235
Database
ISI
SICI code
1045-9227(200103)12:2<228:RNFWCV>2.0.ZU;2-O
Abstract
Regularization networks are nonparametric estimators obtained from the appl ication of Tychonov regularization or Bayes estimation to the hypersurface reconstruction problem, Their main drawback is that the computation of the weights scales as O(n(3)) where n is the number of data. In this paper, we show that for a class of monodimensional problems, the complexity can be re duced to O(n) by a suitable algorithm based on spectral factorization and K alman filtering, Moreover, the procedure applies also to smoothing splines.