MULTIMODAL INTERFACES

In this paper, we present an overview of research in our laboratories on Multimodal Human Computer Interfaces. The goal for such interfaces is to free human computer interaction from the limitations and accepta nce barriers due to rigid operating commands and keyboards as the only /main I/O-device. Instead we move to involve all available human commu nication modalities. These human modalities include Speech, Gesture an d Pointing, Eye-Gaze, Lip Motion and Facial Expression, Handwriting, F ace Recognition, Face Tracking, and Sound Localization.