ENTROPY OF ENGLISH TEXT - EXPERIMENTS WITH HUMANS AND A MACHINE LEARNING-SYSTEM BASED ON ROUGH SETS

The goal of this paper is to show the dependency of the entropy of Eng lish text on the subject of the experiment, the type of English text, and the methodology used to estimate the entropy. Claude Shannon first described the technique for estimating the entropy of English text by a human subject guessing the next letter after viewing a string of ch aracters taken from actual text. We show how this result is affected b y using different humans in the experiment (Shannon used only his wife ) and by using different types of text material (Shannon used only a s ingle book). We also show how the results are affected when we replace the human subjects with a machine learning system based on rough sets . Automating the play of the guessing game with this system, called LE RS, gives rise to a lossless data compression scheme. (C) Elsevier Sci ence Inc. 1998.