Beyond storage capacity in a single model neuron: Continuous replica symmetry breaking

A single McCulloch-Pitts neuron, that is, the simple perceptron is studied, with focus on the region beyond storage capacity. It is shown that Parisi' s hierarchical ansatz for the overlap matrix of the synaptic couplings with so called continuous replica symmetry breaking is a solution, and as we pr opose it is the exact one, to the equilibrium problem. We describe some of the most salient Features of the theory and give results about the low temp erature region. In particular, the basics of the Parisi technique and the w ay to calculate thermodynamical expectation values is explained. We have nu merically extremized the replica free energy functional for some parameter settings, and thus obtained the order parameter function, i.e., the probabi lity distribution of overlaps. That enabled us to evaluate the probability density of the local stability parameter. We also performed a simulation an d found a local stability density closer to the theoretical curve than prev ious numerical results were.