We study the number of hidden layers required by a multilayer neural networ
k with threshold units to compute a dichotomy from R-d to {0, 1}, defined b
y a finite set of hyperplanes. We show that this question is far more intri
cate than computing Boolean functions, although this well-known problem is
underlying our research. We present advanced results on the characterizatio
n of dichotomies, from R-2 to {0, 1}, which require two hidden layers to be
exactly realized.