Distortion bounds for vector quantizers with finite codebook size

Citation
R. Meir et V. Maiorov, Distortion bounds for vector quantizers with finite codebook size, IEEE INFO T, 45(5), 1999, pp. 1621-1631
Citations number
18
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
45
Issue
5
Year of publication
1999
Pages
1621 - 1631
Database
ISI
SICI code
0018-9448(199907)45:5<1621:DBFVQW>2.0.ZU;2-T
Abstract
Upper and lower bounds are presented for the distortion of the optimal N-po int vector quantizer applied to k-dimensional signals. Under certain smooth ness conditions on the source distribution, the bounds are shown to hold fo r each and every value of N, the codebook size. These results extend hounds derived in the high-resolution limit, which assumes that the number of cod e vectors is arbitrarily large. Two approaches to the upper bound are prese nted. The first, constructive construction, achieves the correct asymptotic rate of convergence as well as the correct dependence on the source densit y, although leading to an inferior value for the constant. The second const ruction, based on a random coding argument, is shown to additionally achiev e a value of the constant which is much closer to the best known result der ived within the asymptotic theory. Lower bound results derived in the corre spondence are again shown to possess the correct asymptotic form and yield a constant which is almost indistinguishable from the best value achieved i n the asymptotic regime. Finally, application of the results to the problem of source coding yields upper bounds on the distortion rate function for a wide class of processes.