We demonstrate that it is possible to approximate the mutual information ar
bitrarily closely in probability by calculating relative frequencies on app
ropriate partitions and achieving conditional independence on the rectangle
s of which the partitions are made. Empirical results, including a comparis
on with maximum-likelihood estimators, are presented.