Newsgroups: comp.speech
Path: pavo.csi.cam.ac.uk!warwick!pipex!uunet!spool.mu.edu!agate!ames!purdue!mentor.cc.purdue.edu!noose.ecn.purdue.edu!ecn.purdue.edu!helz
From: helz@ecn.purdue.edu (Randall A Helzerman)
Subject: Re: Entropy of English text?
Message-ID: <CAt6vu.8q5@noose.ecn.purdue.edu>
Sender: news@noose.ecn.purdue.edu (USENET news)
Organization: Purdue University Engineering Computer Network
References:  <CAs7pD.HCC@newcastle.ac.uk>
Date: Tue, 27 Jul 1993 05:50:18 GMT
Lines: 11

In article <CAs7pD.HCC@newcastle.ac.uk>, d.j.e.nunn@durham.ac.uk (Douglas Nunn) writes:
|> Can some kind soul give me a reasonable figure for the average 
|> entropy of typical English text?
|> 
|> I'll leave any assumptions up to you.
|> 

Well, The Man himself Claude E. Shannon in his paper "The Mathematical
Theory of Communication" says that English is about 50% redundant. 
(1-entropy=redundancy).

