We investigate the problem of selecting an informative subsample out o
f a neural network's training data. Using the replica method of statis
tical mechanics, we calculate the performance of a heuristic selection
algorithm for a linear neural network which avoids overfitting.