Active learning for optimal generalization in trigonometric polynomial models

Citation
M. Sugiyama et H. Ogawa, Active learning for optimal generalization in trigonometric polynomial models, IEICE T FUN, E84A(9), 2001, pp. 2319-2329
Citations number
26
Categorie Soggetti
Eletrical & Eletronics Engineeing
Journal title
IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES
ISSN journal
09168508 → ACNP
Volume
E84A
Issue
9
Year of publication
2001
Pages
2319 - 2329
Database
ISI
SICI code
0916-8508(200109)E84A:9<2319:ALFOGI>2.0.ZU;2-2
Abstract
In this paper, we consider the problem of active learning, and give a neces sary and sufficient condition of sample points for the optimal generalizati on capability. By utilizing the properties of pseudo orthogonal bases, we c larify the mechanism of achieving the optimal generalization capability. We also show that the condition does not only provide the optimal generalizat ion capability but also reduces the computational complexity and memory req uired to calculate learning result functions. Based on the optimality condi tion, we give design methods of optimal sample points for trigonometric pol ynomial models. Finally, the effectiveness of the proposed active learning method is demonstrated through computer simulations.