TRANSFER OF FIXATION USING AFFINE STRUCTURE - EXTENDING THE ANALYSIS TO STEREO

This paper describes an algorithm for maintaining fixation upon a 3D b ody-centred point using 3D affine transfer, extending an earlier monoc ular method to stereo cameras. Transfer is based on corners detected i n the image and matched over time and in stereo. The paper presents a method using all available matched data, providing immunity to noise a nd poor conditioning. The algorithm, implemented at video rates on a m ulti-processor machine, incorporates controlled degradation in the pre sence of insufficient data. Results are given from experiments using a four-axis active stereo camera platform, first which show the greater stability of the fixation point over the monocular method, both as it appears in the image and occurs in the scene; and, secondly, which sh ow the recovery and evolution of 3D affine structure during fixation. It is shown that fixation and explicit structure recovery can occur se parately, allowing the information required for gaze control to be com puted in a fixed time.