A NEW KIND OF NEURON MODEL WITH A TUNABLE ACTIVATION FUNCTION AND ITSAPPLICATIONS

Citation
Ys. Wu et al., A NEW KIND OF NEURON MODEL WITH A TUNABLE ACTIVATION FUNCTION AND ITSAPPLICATIONS, SCI CHINA E, 40(1), 1997, pp. 105-112
Citations number
8
Categorie Soggetti
Engineering,"Material Science
Journal title
SCIENCE IN CHINA SERIES E-TECHNOLOGICAL SCIENCES
ISSN journal
20950624 → ACNP
Volume
40
Issue
1
Year of publication
1997
Pages
105 - 112
Database
ISI
SICI code
2095-0624(1997)40:1<105:ANKONM>2.0.ZU;2-5
Abstract
A new neuron model with a tunable activation function, denoted by the TAF model, and its application are addressed. The activation function as well as the connection weights of the neuron model can be adjusted in the training process. The two-spiral problem was used as an example to show how to deduce the adjustable activation function required, an d how to construct and train the network by the use of the a priori kn owledge of the problem. Due to the incorporation of constraints known a priori into the activation function, many novel aspects are revealed , such as small network size, fast learning and good performances. It is believed that the introduction of the new neuron model will pave a new way in ANN studies.