AUGMENTED REALITY THROUGH WEARABLE COMPUTING

Wearable computing moves computation from the desktop to the user. We are forming a community of networked, wearable-computer users to explo re, over a long period, the augmented realities that these systems can provide. By adapting its behavior to the user's changing environment, a body-worn computer can assist the user more intelligently, consiste ntly, and continuously than a desktop system. A text-based augmented r eality, the Remembrance Agent, is presented to illustrate this approac h. Video cameras are used both to warp the visual input (mediated real ity) and to sense the user's world for graphical overlay. With a camer a, the computer could track the user's finger-to act as the system's m ouse; perform face recognition; and detect passive objects to overlay 2.5D and 3D graphics onto the real world. Additional apparatus such as audio systems, infrared beacons For sensing location, and biosensors for learning about the wearer's affect are described. With the use of input from these interface devices and sensors, a long-term goal of th is project is to model the user's actions, anticipate his or her needs , and perform a seamless interaction between the virtual and physical environments.