Twofold universal prediction schemes for achieving the finite-state predictability of a noisy individual binary sequence

Citation
T. Weissman et al., Twofold universal prediction schemes for achieving the finite-state predictability of a noisy individual binary sequence, IEEE INFO T, 47(5), 2001, pp. 1849-1866
Citations number
47
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
47
Issue
5
Year of publication
2001
Pages
1849 - 1866
Database
ISI
SICI code
0018-9448(200107)47:5<1849:TUPSFA>2.0.ZU;2-E
Abstract
The problem of predicting the next outcome of an individual binary sequence corrupted by noise using finite memory, is considered. The conditional fin ite-state (FS) predictability of an infinite individual sequence given its noisy version is defined as the minimum fraction of errors that can be made by any FS predictor fed by the noisy version. It is proved that the condit ional FS predictability can be attained almost surely by universal sequenti al prediction schemes in the case where the noisy version is the output of a binary-symmetric channel (BSC) whose input is the clean individual sequen ce. In particular, universal predictors of the original noise-free setting, which operate on the noisy sequence, have this property. Moreover, these u niversal predictors do not depend on the crossover probability characterizi ng the BSC, It is seen that the noisy setting gives rise to additional crit eria by which the performance of prediction schemes can be assessed. Finall y, a closer look is taken at the conditional FS predictability, and this qu antity is proposed as an additional measure of the complexity of a sequence , perhaps finer and more informative than the predictive complexity of the noise-free setting.