A COMPARISON OF ID3 AND BACKPROPAGATION FOR ENGLISH TEXT-TO-SPEECH MAPPING

Citation
Tg. Dietterich et al., A COMPARISON OF ID3 AND BACKPROPAGATION FOR ENGLISH TEXT-TO-SPEECH MAPPING, Machine learning, 18(1), 1995, pp. 51-80
Citations number
22
Categorie Soggetti
Computer Sciences","Computer Science Artificial Intelligence",Neurosciences
Journal title
ISSN journal
08856125
Volume
18
Issue
1
Year of publication
1995
Pages
51 - 80
Database
ISI
SICI code
0885-6125(1995)18:1<51:ACOIAB>2.0.ZU;2-4
Abstract
The performance of the error backpropagation (BP) and ID3 learning alg orithms was compared on the task of mapping English text to phonemes a nd stresses. Under the distributed output code developed by Sejnowski and Rosenberg, it is shown that BP consistently out-performs ID3 on th is task by several percentage points. Three hypotheses explaining this difference were explored: (a) ID3 is overfitting the training data, ( b) BP is able to share hidden units across several output units and he nce can learn the output units better, and (c) BP captures statistical information that ID3 does not. We conclude that only hypothesis (c) i s correct. By augmenting ID3 with a simple statistical learning proced ure, the performance of BP can be closely matched. More complex statis tical procedures can improve the performance of both BP and ID3 substa ntially in this domain.