AN ISOLATED WORD SPEECH RECOGNITION USING FUSION OF AUDITORY AND VISUAL INFORMATION

We propose a speech recognition method using fusion of auditory and vi sual information for accurate speech recognition. Since we use both au ditory information and visual information, we can perform speech recog nition more accurately in comparison with the case of either auditory information or visual information. After processing each information b y HMM, they are fused by linear combination with weight coefficient. W e performed experiments and confirmed the validity of the proposed met hod.