P-sufficient statistics for PAC learning k-term-DNF formulas through enumeration

Citation
B. Apolloni et C. Gentile, P-sufficient statistics for PAC learning k-term-DNF formulas through enumeration, THEOR COMP, 230(1-2), 2000, pp. 1-37
Citations number
41
Categorie Soggetti
Computer Science & Engineering
Journal title
THEORETICAL COMPUTER SCIENCE
ISSN journal
03043975 → ACNP
Volume
230
Issue
1-2
Year of publication
2000
Pages
1 - 37
Database
ISI
SICI code
0304-3975(20000106)230:1-2<1:PSFPLK>2.0.ZU;2-#
Abstract
Working in the framework of PAC-learning theory, we present special statist ics for accomplishing in polynomial time proper learning of DNF boolean for mulas having a fixed number of monomials. Our statistics turn out to be nea r sufficient for a large family of distribution laws - that we call butterf ly distributions. We develop a theory of most powerful learning for analyzi ng the performance of learning algorithms, with particular reference to tra de-offs between power and computational costs. Focusing attention on sample and time complexity, we prove that our algorithm works as efficiently as t he best algorithms existing in the literature - while the latter only take care of subclasses of our family of distributions. (C) 2000 Elsevier Scienc e B.V. All rights reserved.