J. Feng et B. Tirozzi, AN ANALYSIS ON NEURAL DYNAMICS WITH SATURATED SIGMOIDAL FUNCTIONS, Computers & mathematics with applications, 34(10), 1997, pp. 71-99
We propose a unified approach to study the relation between the set of
saturated attractors and the set of system parameters of the Hopfield
model, Linsker's model, and the dynamic link network (DLN), which use
saturated sigmoidal functions in its dynamics of the state or weight.
The key point for this approach is to rigorously derive a necessary a
nd sufficient condition to test whether a given saturated state (in th
e Hopfield model) or weight vector (in Linsker's model and the DLN) is
stable or not for any given set of system parameters, and used this t
o determine the complete regime in the parameter space over which the
given state or weight is stable. Our approach allows us to give an exa
ct characterization between the parameters and the capacity in the Hop
field model; to generalize our previous results on Linsker's network a
nd the DLN; to have a better understanding of the underlying mechanism
among these models. The method reported here could be adopted to anal
yze a variety of models in the field of the neural networks.