DETERMINATION OF FEATURE CORRESPONDENCES IN STEREO IMAGES USING A CALIBRATION POLYGON

In this paper, we propose a novel approach to solving the vertex/edge correspondence problem for stereo images. Assume an object is placed o n a calibration plate (C-plate) and two perspective views of them are given. The C-plate vertex correspondence, determined by cross-ratios, is used to reduce the search space for determining object vertex/edge correspondence. First, the correspondence of object edges lying on the C-plate (called the object base edges) is considered. This is because the subpolygons obtained from the division of the C-plate by the exte nded line of each of these base edges are viewpoint invariant, i.e. th e cross-ratio of each of their vertices in different images will have equal value. Assume that at least one of the base edges is visible in each image. Since a visible object base edge has to be an object bound ary edge in an image, only object boundary edges will be considered fo r the cross-ratios check for the associated subpolygons as well as oth er geometric constraint checks in determining the object base vertex/e dge correspondence. These geometric constraints include (i) the positi on of the edges along the boundary of object faces, and (ii) the divis ion of the C-plate vertices by the extended lines of these edges. Base d on one of the determined corresponding base edge pairs, the correspo ndence of all other edges can be determined by constraints similar to (i). Finally, some additional viewpoint invariant measures about the o bject faces and the C-plates are introduced to resolve the ambiguity p roblem which may arise for specific viewpoints and some special object shapes. The proposed approach only needs 2-D image data and has no co nstraint on the number of vertices of an object face. Experimental res ults are presented for some polyhedral as well as curved objects. (C) 1997 Pattern Recognition Society. Published by Elsevier Science Ltd.