Retarded learning: Rigorous results from statistical mechanics

Citation
D. Herschkowitz et M. Opper, Retarded learning: Rigorous results from statistical mechanics, PHYS REV L, 86(10), 2001, pp. 2174-2177
Citations number
26
Categorie Soggetti
Physics
Journal title
PHYSICAL REVIEW LETTERS
ISSN journal
00319007 → ACNP
Volume
86
Issue
10
Year of publication
2001
Pages
2174 - 2177
Database
ISI
SICI code
0031-9007(20010305)86:10<2174:RLRRFS>2.0.ZU;2-4
Abstract
We study learning of probability distributions characterized by an unknown symmetry direction. Based on an entropic performance measure and the variat ional method of statistical mechanics we develop exact upper and lower boun ds on the scaled critical number of examples below which learning of the di rection is impossible. The asymptotic tightness of the bounds suggests an a symptotically optimal method for learning nonsmooth distributions.