LEARNABILITY OF PERIODIC ACTIVATION FUNCTIONS - GENERAL RESULTS

Authors
ROSENZVI M BIEHL M KANTER I
Citation
M. Rosenzvi et al., LEARNABILITY OF PERIODIC ACTIVATION FUNCTIONS - GENERAL RESULTS, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics, 58(3), 1998, pp. 3606-3609
Citations number
16
Categorie Soggetti
Physycs, Mathematical","Phsycs, Fluid & Plasmas
Journal title
Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics → ACNP
ISSN journal
1063651X
Volume
58
Issue
3
Year of publication
1998
Part
B
Pages
3606 - 3609
Database
ISI
SICI code
1063-651X(1998)58:3<3606:LOPAF->2.0.ZU;2-M
Abstract
On-line learning in the presence of continuous periodic activation fun ctions is studied analytically. The effect of the ambiguity (an infini te number of inputs with different local fields can produce the same o utput) on the learnability is examined. A universal interplay between the general features of the activation function (wave number, parity, etc.) and the critical learning rate is found. Analytical results are extended also to multilayer architectures with nonlinear output units. Results are compared with simulations.