NEURAL NETWORKS WITH HIGH-ORDER CONNECTIONS

Citation
Jj. Arenzon et Rmc. Dealmeida, NEURAL NETWORKS WITH HIGH-ORDER CONNECTIONS, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics, 48(5), 1993, pp. 4060-4069
Citations number
28
Categorie Soggetti
Physycs, Mathematical","Phsycs, Fluid & Plasmas
ISSN journal
1063651X
Volume
48
Issue
5
Year of publication
1993
Pages
4060 - 4069
Database
ISI
SICI code
1063-651X(1993)48:5<4060:NNWHC>2.0.ZU;2-#
Abstract
We present results for two different kinds of high-order connections b etween neurons acting as corrections to the Hopfield model. Equilibriu m properties are analyzed using the replica mean-field theory and comp ared with numerical simulations. An optimal learning algorithm for fou rth-order connections is given that improves the storage capacity with out increasing the weight of the higher-order term. While the behavior of one of the models qualitatively resembles the original Hopfield on e, the other presents a new and very rich behavior: depending on the s trength of the fourth-order connections and the temperature, the syste m presents two distinct retrieval regions separated by a gap, as well as several phase transitions. Also, the spin-glass states seems to dis appear above a certain value of the load parameter alpha, alpha(g).