Theoretical study of mean-field Boltzmann machine learning by information geometry

Citation
T. Arai et al., Theoretical study of mean-field Boltzmann machine learning by information geometry, ELEC C JP 3, 82(8), 1999, pp. 30-39
Citations number
21
Categorie Soggetti
Eletrical & Eletronics Engineeing
Journal title
ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE
ISSN journal
10420967 → ACNP
Volume
82
Issue
8
Year of publication
1999
Pages
30 - 39
Database
ISI
SICI code
1042-0967(199908)82:8<30:TSOMBM>2.0.ZU;2-G
Abstract
Mean-field Boltzmann machine learning is recognized as a practical method t o circumvent the difficulty that Boltzmann machine learning is very time;co nsuming. However, its theoretical meaning is still not clear In this paper, based on information geometry, we give an information-theoretic interpreta tion of mean-field Boltzmann machine learning and a clear geometrical expla nation of the approximation used there. Based on this interpretation, compu ter simulations for evaluating the effectiveness of mean-field Boltzmann ma chine learning are carried out for two-unit Boltzmann machines. The necessi ty of geometrical analysis in demonstrating the effectiveness of meanfield Boltzmann machine learning is, discussed. (C) 1999 Scripta Technica.