INITIALIZATION OF NEURAL NETWORKS BY MEANS OF DECISION TREES

Authors
Citation
I. Ivanova et M. Kubat, INITIALIZATION OF NEURAL NETWORKS BY MEANS OF DECISION TREES, Knowledge-based systems, 8(6), 1995, pp. 333-344
Citations number
29
Categorie Soggetti
System Science","Computer Science Artificial Intelligence
Journal title
ISSN journal
09507051
Volume
8
Issue
6
Year of publication
1995
Pages
333 - 344
Database
ISI
SICI code
0950-7051(1995)8:6<333:IONNBM>2.0.ZU;2-T
Abstract
The performance of neural networks is known to be sensitive to the ini tial weight setting and architecture (the number of hidden layers and neurons in these layers). This shortcoming can be alleviated if some a pproximation of the target concept in terms of a logical description i s available. The paper reports a successful attempt to initialize neur al networks using decision-tree generators. The TBNN (tree-based neura l net) system compares very Favourably with other learners in terms of classification accuracy for unseen data, and it is also computational ly less demanding than the back propagation algorithm applied to a ran domly initialized multilayer perceptron. The behavior of the system is first studied for specially designed artificial data. Then, its perfo rmance is demonstrated by a real-world application.