BACKPROPAGATION LEARNING ALGORITHM WITH DIFFERENT LEARNING COEFFICIENTS FOR EACH LAYER

Citation
H. Takechi et al., BACKPROPAGATION LEARNING ALGORITHM WITH DIFFERENT LEARNING COEFFICIENTS FOR EACH LAYER, Systems and computers in Japan, 26(7), 1995, pp. 47-56
Citations number
9
Categorie Soggetti
Computer Science Hardware & Architecture","Computer Science Information Systems","Computer Science Theory & Methods
ISSN journal
08821666
Volume
26
Issue
7
Year of publication
1995
Pages
47 - 56
Database
ISI
SICI code
0882-1666(1995)26:7<47:BLAWDL>2.0.ZU;2-X
Abstract
When considering the algorithm of error backpropagation learning, it i s seen that the learning of each layer is not completed independently. This paper proposes a DLBP learning algorithm which uses different le arning coefficients for each layer. By changing the ratio of the learn ing coefficients, the following can be controlled: the learning progre ss of the hidden units; the influence of the hidden units on the netwo rk. With DLBP learning, we can construct the corresponding networks to the different requirement such as; to obtain a network with small num ber of hidden units; and to obtain a fault tolerant network.