3-D scene reconstruction with viewpoint adaptation on stereo displays

In this paper, we propose a generic algorithm for the geometrically correct reconstruction of 3-D scenes on stereo displays with viewpoint adaptation. This forms the basis of multiviewpoint systems, which are currently the mo st promising candidates for real-time implementations of 3-D visual communi cation systems, The reconstruction algorithm needs 3-D tracking of the view ers' eyes with respect to the display. We analyze the effect of eye-trackin g errors. A simple bound will be derived, below which reconstruction errors cannot be observed. We design a multiviewpoint system using a recently int roduced image-based scene representation. The design formed the basis of th e real-time multiviewpoint system that was recently built in the European P ANORAMA project. Experiments with both natural and synthetic scenes show th at the proposed reconstruction algorithm performs well, The experiments are performed by computer simulations and the real-time PANORAMA system.