BACKPROPAGATION USES PRIOR INFORMATION EFFICIENTLY

Citation
E. Barnard et Ec. Botha, BACKPROPAGATION USES PRIOR INFORMATION EFFICIENTLY, IEEE transactions on neural networks, 4(5), 1993, pp. 794-802
Citations number
14
Categorie Soggetti
Computer Application, Chemistry & Engineering","Engineering, Eletrical & Electronic","Computer Applications & Cybernetics
ISSN journal
10459227
Volume
4
Issue
5
Year of publication
1993
Pages
794 - 802
Database
ISI
SICI code
1045-9227(1993)4:5<794:BUPIE>2.0.ZU;2-H
Abstract
The ability of neural net classifiers to deal with a priori informatio n is investigated. For this purpose, back-propagation classifiers are trained with data from known distributions with variable a priori prob abilities, and their performance on separate test sets is evaluated. I t is found that back-propagation employs a priori information in a sli ghtly suboptimal fashion, but that this does not have serious conseque nces on the performance of this classifier. Furthermore, it is found t hat the inferior generalization that results when an excessive number of network parameters are used can (partially) be ascribed to this sub optimality.