In this paper we present a novel approach for building detection from multi
ple aerial images in dense urban areas. The approach is based on accurate s
urface reconstruction, followed by extraction of building facades that are
used as a main cue for building detection. For the facade detection, a simp
le but nevertheless flexible and robust algorithm is proposed. It is based
on the observation that building facades correspond to the accumulation of
3D data, available from different views, in object space. Knowledge-driven
thresholding of 3D data accumulators followed by Hough transform-based segm
ent detection results in the extraction of facade positions. Three-dimensio
nal planar regions resulting from surface reconstruction procedure and boun
ded by the extracted facades are detected as building hypotheses through te
sting a set of spatial criteria. Then, a set of verification criteria is pr
oposed for the hypothesis confirmation. (C) 2001 Academic Press.