Minimum cross-entropy estimation with inaccurate side information

Authors
Citation
Ll. Campbell, Minimum cross-entropy estimation with inaccurate side information, IEEE INFO T, 45(7), 1999, pp. 2650-2652
Citations number
15
Categorie Soggetti
Information Tecnology & Communication Systems
Journal title
IEEE TRANSACTIONS ON INFORMATION THEORY
ISSN journal
00189448 → ACNP
Volume
45
Issue
7
Year of publication
1999
Pages
2650 - 2652
Database
ISI
SICI code
0018-9448(199911)45:7<2650:MCEWIS>2.0.ZU;2-L
Abstract
Given a prior estimate of a probability, q, and a constraint Sigma p(i)x(i) = a, one well-known way of estimating p is to minimize the cross-entropy I (p:q) subject to the constraint. A modification to this method is proposed for use when the value a is only approximately known. The modification is b ased on the penalty function method in constrained optimization. It has an interpretation in differential geometry methods in statistics and it someti mes gives a maximum-likelihood estimate.