S. Ma et Cy. Ji, A UNIFIED APPROACH ON FAST TRAINING OF FEEDFORWARD AND RECURRENT NETWORKS USING EM ALGORITHM, IEEE transactions on signal processing, 46(8), 1998, pp. 2270-2274
In this work, we provide a theoretical framework that unifies the noti
ons of hidden representations and moving targets through the expectati
on and maximization (EM) algorithm. Based on such a framework, two fas
t training algorithms can be derived consistently for both feedforward
networks and recurrent networks.