ESTIMATIONS OF PREVIEWED ROAD CURVATURES AND VEHICULAR MOTION BY A VISION-BASED DATA FUSION SCHEME

In this study, a new framework of vision-based estimation is developed using some data fusion schemes to obtain previewed road curvatures an d vehicular motion states based on the scene viewed from an in-vehicle camera. The previewed curvatures are necessary for the guidance of an automatically steering vehicle, and the desired vehicular motion vari ables, including lateral deviation, heading angle, yaw rate, and sides lip angle, are also required for proper control of the vehicular later al motion via steering. In this framework, physical relationships of p reviewed curvatures among consecutive images, motion variables in term s of image features searched at various levels in the image plane, and dynamic correlation among vehicular motion variables are derived as b ases of data fusion to enhance the accuracy of estimation. The vision- based measurement errors are analyzed to determine the fusion gains ba sed on the technique of a Kalman filter such that the measurements fro m the image plane and predictions of physical models can be properly i ntegrated to obtain reliable estimations. Off-line experimental works using real road scenes are performed to verify the whole framework for image sensing.