Estimation of the information by an adaptive partitioning of the observation space

Citation
Ga. Darbellay et I. Vajda, Estimation of the information by an adaptive partitioning of the observation space, IEEE INFO T, 45(4), 1999, pp. 1315-1321
Citations number
17
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
45
Issue
4
Year of publication
1999
Pages
1315 - 1321
Database
ISI
SICI code
0018-9448(199905)45:4<1315:EOTIBA>2.0.ZU;2-S
Abstract
We demonstrate that it is possible to approximate the mutual information ar bitrarily closely in probability by calculating relative frequencies on app ropriate partitions and achieving conditional independence on the rectangle s of which the partitions are made. Empirical results, including a comparis on with maximum-likelihood estimators, are presented.