On-line retrainable neural networks: Improving the performance of neural networks in image analysis problems

Citation
Ad. Doulamis et al., On-line retrainable neural networks: Improving the performance of neural networks in image analysis problems, IEEE NEURAL, 11(1), 2000, pp. 137-155
Citations number
41
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
IEEE TRANSACTIONS ON NEURAL NETWORKS
ISSN journal
10459227 → ACNP
Volume
11
Issue
1
Year of publication
2000
Pages
137 - 155
Database
ISI
SICI code
1045-9227(200001)11:1<137:ORNNIT>2.0.ZU;2-7
Abstract
A novel approach is presented in this paper for improving the performance o f neural-network classifiers in image recognition, segmentation, or coding applications, based on a retraining procedure at the user level. The proced ure includes: 1) a training algorithm for adapting the network weights to t he current condition; 2) a maximum a posteriori (MAP) estimation procedure for optimally selecting the most representative data of the current environ ment as retraining data; and 3) a decision mechanism for determining when n etwork retraining should be activated. The training algorithm takes into co nsideration both the former and the current network knowledge in order to a chieve good generalization. The MAP estimation procedure models the network output as a Markov random field (MRF) and optimally selects the set of tra ining inputs and corresponding desired outputs, Results are presented which illustrate the theoretical developments as well as the performance of the proposed approach in real-life experiments.