Measuring time-frequency information content using the Renyi entropies

Citation
Rg. Baraniuk et al., Measuring time-frequency information content using the Renyi entropies, IEEE INFO T, 47(4), 2001, pp. 1391-1409
Citations number
39
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
47
Issue
4
Year of publication
2001
Pages
1391 - 1409
Database
ISI
SICI code
0018-9448(200105)47:4<1391:MTICUT>2.0.ZU;2-A
Abstract
The generalized entropies of Renyi inspire new measures for estimating sign al information and complexity in the time-frequency plane. When applied to a time-frequency representation (TFR) from Cohen's class or the affine clas s, the Renyi entropies conform closely to the notion of complexity that we use when visually inspecting time-frequency images. These measures possess several additional interesting and useful properties, such as accounting an d cross-component and transformation invariances, that make them natural fo r time-frequency analysis. This paper comprises a detailed study of the pro perties and several potential applications of the Renyi entropies, with emp hasis on the mathematical foundations for quadratic TFRs. in particular, fo r the Wigner distribution, we establish that there exist signals for which the measures are not well defined.