Csiszar's cutoff rates for arbitrary discrete sources

Citation
Pn. Chen et F. Alajaji, Csiszar's cutoff rates for arbitrary discrete sources, IEEE INFO T, 47(1), 2001, pp. 330-338
Citations number
18
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
47
Issue
1
Year of publication
2001
Pages
330 - 338
Database
ISI
SICI code
0018-9448(200101)47:1<330:CCRFAD>2.0.ZU;2-2
Abstract
Csiszar's forward beta -cutoff rate (given a fixed beta > 0) for a discrete source is defined as the smallest number Ro such that for every R > R-0, t here exists a sequence of tired-length codes of rate R with probability of error asymptotically vanishing as e(-n beta (R-R0)). For a discrete memoryl ess source (DMS), the forward beta -cutoff rate is shown by Csiszar [6] to be equal to the source Renyi entropy. An analogous concept of reverse beta -cutoff rate regarding the probability of correct decoding is also characte rized by Csiszar in terms of the Renyi entropy. In this work, Csiszar's results are generalized by investigating the beta - cutoff rates for the class of arbitrary discrete sources with memory. It is demonstrated that the limsup and liminf Renyi entropy rates provide the fo rmulas for the forward and reverse beta -cutoff rates, respectively. Conseq uently, new fixed-length source coding operational characterizations for th e Renyi entropy rates are established.