Learning with maximum-entropy distributions

Citation
Y. Mansour et M. Schain, Learning with maximum-entropy distributions, MACH LEARN, 45(2), 2001, pp. 123-145
Citations number
16
Categorie Soggetti
AI Robotics and Automatic Control
Journal title
MACHINE LEARNING
ISSN journal
08856125 → ACNP
Volume
45
Issue
2
Year of publication
2001
Pages
123 - 145
Database
ISI
SICI code
0885-6125(2001)45:2<123:LWMD>2.0.ZU;2-Z
Abstract
We are interested in distributions which are derived as a maximum entropy d istribution from a given set of constraints. More specifically, we are inte rested in the case where the constraints are the expectation of individual and pairs of attributes. For such a given maximum entropy distribution (wit h some technical restrictions) we develop an efficient learning algorithm f or read-once DNF. We extend our results to monotone read-k DNF following th e techniques of (Hancock & Mansour, 1991).