WEIGHTED LINEAR ASSOCIATIVE MEMORY APPROACH TO NONLINEAR PARAMETER-ESTIMATION

Authors
Citation
Jc. Lin et Dm. Durand, WEIGHTED LINEAR ASSOCIATIVE MEMORY APPROACH TO NONLINEAR PARAMETER-ESTIMATION, Journal of optimization theory and applications, 90(1), 1996, pp. 139-159
Citations number
14
Categorie Soggetti
Operatione Research & Management Science",Mathematics,"Operatione Research & Management Science
ISSN journal
00223239
Volume
90
Issue
1
Year of publication
1996
Pages
139 - 159
Database
ISI
SICI code
0022-3239(1996)90:1<139:WLAMAT>2.0.ZU;2-S
Abstract
The method of linear associative memory (LAM), a notion from the field of artificial neural nets, has been applied recently in nonlinear par ameter estimation. In the LAM method, a model response, nonlinear with respect to the parameters, is approximated linearly by a matrix, whic h maps inversely from a response vector to a parameter vector. This ma trix is determined from a set of initial training parameter vectors an d their response vectors, and can be updated recursively and adaptivel y with a pair of newly generated parameter response vectors. The LAM a dvantage is that it can yield a good estimation of the true parameters from a given observed response, even if the initial training paramete r vectors are far from the true values. In this paper, we present a we ighted linear associative memory (WLAM) for nonlinear parameter estima tion. WLAM improves LAM by taking into account an observed response ve ctor oriented weighting. The basic idea is to weight each pair of para meter response vectors in the cost function such that, if a response v ector is closer to the observed one, then this pair plays a more impor tant role in the cost function. This weighting algorithm improves sign ificantly the accuracy of parameter estimation as compared to a LAM wi thout weighting. In addition, we are able to construct the associative memory matrix recursively, while taking the weighting procedure into account, and simultaneously update the ridge parameter a of the cost f unction further improving the efficiency of the WLAM estimation. These features enable WLAM to be a powerful tool for nonlinear parameter si mulation.