Methods of user-computer interaction have remained largely unchanged since
the introduction of graphical user interfaces and their popularization by t
he Apple Macintosh in the early 1980s. Most of today's applications rely on
primitive modalities, such as typing and pointing for input generation, wh
ich works well for a host of common business applications, but falls short
for more complex tasks. To improve the interaction between user and compute
r we propose a concept that allows people to visualize their ideas, problem
s, or instructions during the initial phase of an interaction with a comput
er by augmenting traditional interaction modalities with sketching, gesturi
ng and talking. This approach leads to a more natural user-computer interac
tion and enhances a user's ability to find solutions to a problem. We sugge
st that computers become actively involved in the process of problem formul
ation and that they provide support and give advice where this is adequate.
This leads to a process of incremental problem formulation where user and
computer are able to better visualize the actual task and fewer misundersta
ndings occur. Geographic information systems (GIS) would benefit from impro
ved user interaction techniques. GIS are inherently complex and an interact
ion is often tedious, mostly because such systems are based on sequential a
nd nonspatial input methods that lack the capability of expressing spatial
concepts appropriately. We advocate for a visualization in an early stage o
f the problem solving process in GIS and discuss its advantages and challen
ges. The paper gives application examples and discusses future research top
ics. (C) 2000 Elsevier Science Ltd. All rights reserved.