Coding of sources with two-sided geometric distributions and unknown parameters

Citation
N. Merhav et al., Coding of sources with two-sided geometric distributions and unknown parameters, IEEE INFO T, 46(1), 2000, pp. 229-236
Citations number
29
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
46
Issue
1
Year of publication
2000
Pages
229 - 236
Database
ISI
SICI code
0018-9448(200001)46:1<229:COSWTG>2.0.ZU;2-X
Abstract
Lossless compression is studied for a countably infinite alphabet source wi th an unknown, off-centered, two-sided geometric (TSG) distribution, which is a commonly used statistical model for image prediction residuals. In thi s correspondence, we demonstrate that arithmetic coding based on a simple s trategy of model adaptation, essentially attains the theoretical lower boun d to the universal coding redundancy associated with this model. We then fo cus on more practical codes for the TSG model, that operate on a symbol-by- symbol basis, and study the problem of adaptively selecting a code from a g iven discrete family. By taking advantage of the structure of the optimum H uffman tree for a known TSG distribution, which enables simple calculation of the codeword of every given source symbol, an efficient adaptive strateg y is derived.