The worst additive noise under a covariance constraint

Citation
Sn. Diggavi et Tm. Cover, The worst additive noise under a covariance constraint, IEEE INFO T, 47(7), 2001, pp. 3072-3081
Citations number
27
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
47
Issue
7
Year of publication
2001
Pages
3072 - 3081
Database
ISI
SICI code
0018-9448(200111)47:7<3072:TWANUA>2.0.ZU;2-K
Abstract
The maximum entropy noise under a lag p autocorrelation constraint is known by Burg's theorem to be the pth order Gauss-Markov process satisfying thes e constraints. The question is, what is the worst additive noise for a comm unication channel given these constraints? Is it the maximum entropy noise? The problem becomes one of extremizing the mutual information over all nois e processes with covariances satisfying the correlation constraints R-0,.., R-p. For high signal powers, the worst additive noise is Gauss-Markov of o rder p as expected. But for low powers, the worst additive noise is Gaussia n with a covariance matrix in a convex set which depends on the signal powe r.