Efficient training of neural nets for nonlinear adaptive filtering using arecursive Levenberg-Marquardt algorithm

Citation
Lsh. Ngia et J. Sjoberg, Efficient training of neural nets for nonlinear adaptive filtering using arecursive Levenberg-Marquardt algorithm, IEEE SIGNAL, 48(7), 2000, pp. 1915-1927
Citations number
31
Categorie Soggetti
Eletrical & Eletronics Engineeing
Journal title
IEEE TRANSACTIONS ON SIGNAL PROCESSING
ISSN journal
1053587X → ACNP
Volume
48
Issue
7
Year of publication
2000
Pages
1915 - 1927
Database
ISI
SICI code
1053-587X(200007)48:7<1915:ETONNF>2.0.ZU;2-7
Abstract
The Levenberg-Marquardt algorithm is often superior to other training algor ithms in off-line applications. This motivates the proposal of using a recu rsive version of the algorithm for on-line training of neural nets for nonl inear adaptive filtering. The performance of the suggested algorithm is com pared with other alternative recursive algorithms, such as the recursive ve rsion of the off-line steepest-descent and Gauss-Newton algorithms. The adv antages and disadvantages of the different algorithms are pointed out, The algorithms are tested on some examples, and it is shown that generally, the recursive Levenberg-Marquardt algorithm has better convergence properties than the other algorithms.