On active camera control and camera motion recovery with foveate wavelet transform

In this paper, a new variable resolution technique-Foveate Wavelet Transfor m (FWT) is proposed to represent digital images in an effort to efficiently represent visual data. Compared to existing variable resolution techniques , the strength of the proposed scheme encompasses its linearity preservatio n, orientation selectivity, and flexibility while supporting interesting be haviors resembling the animate vision system. The linearity preservation of the FWT is due to the fact that only low and/or high-pass filterings are c arried out in different regions of an image in the transform. The orientati on selectivity indicates the fact that details along the horizontal, vertic al, and diagonal directions are readily available in the FWT representation . The flexibility of this new representation technique is witnessed by the readiness of its extensions to represent foveae of different number, shape, and locations. To demonstrate the efficacy of the FWT, two applications ar e presented. First, an FWT-based active camera control scheme is developed, where the computer can move a camera to track the moving object in the sce ne. Second, an FWT-based method purporting to recover pan/tilt/zoom camera movements from video clips is developed. Experiments of these two applicati ons have shown encouraging performances.