Using the cavity method and diagrammatic methods, we model the dynamics of
batch learning of restricted sets of examples, widely applicable to general
learning cost functions, and fully taking into account the temporal correl
ations introduced by the recycling of the examples. The approach is illustr
ated using the Adaline rule learning teacher-generated or random examples.