EDWARD - FULL INTEGRATION OF LANGUAGE AND ACTION IN A MULTIMODAL USER-INTERFACE

This paper presents EDWARD, a multimodal user interface fully integrat ing several interface styles, viz. natural language (Dutch), manipulat ion of graphical representations, menus, and command language. The foc us is on the following two issues: (1) the new design principle of mak ing all interface styles available at all times; and (2) the new gener ic approach in processing referring expressions, which is applied both in interpretation and generation, for all sorts of expressions, inclu ding multimodal deictic expressions such as ''put that there'' with si multaneous pointing gestures. EDWARD is a generic interface, currently applied to the file system domain.