FIXED-RATE UNIVERSAL LOSSY SOURCE-CODING AND RATES OF CONVERGENCE FORMEMORYLESS SOURCES

Citation
T. Linder et al., FIXED-RATE UNIVERSAL LOSSY SOURCE-CODING AND RATES OF CONVERGENCE FORMEMORYLESS SOURCES, IEEE transactions on information theory, 41(3), 1995, pp. 665-676
Citations number
26
Categorie Soggetti
Information Science & Library Science","Engineering, Eletrical & Electronic
ISSN journal
00189448
Volume
41
Issue
3
Year of publication
1995
Pages
665 - 676
Database
ISI
SICI code
0018-9448(1995)41:3<665:FULSAR>2.0.ZU;2-Z
Abstract
A fixed-rate universal lossy coding scheme is introduced for independe nt and identically distributed (i.i.d.) sources, It is shown for finit e alphabet sources and arbitrary single letter distortion measures tha t as the sample size n grows the expected distortion obtained using th is universal scheme converges to Shannon's distortion rate function D( R) at a rate O (log n/n). The scheme can be extended to universal quan tization of real i.i.d sources subject to a squared error criterion, I t is shown in this case that the per-letter distortion converges to D( R) at a rate O(root log n/n) both in expectation and almost surely for any real-valued bounded i.i.d. source.