To achieve smooth real-world interaction between people and computers, we d
eveloped a system that displays a three-dimensional computer-graphic human-
like image from the waist up (anthropomorphic software robot: hereinafter "
robot") on the display, that interactively sees and hears, and that has fin
e and detailed control functions such as facial expressions, line of sight,
and pointing at targets with its finger. The robot visually searches and i
dentifies persons and objects in real space that it has learned in advance
(registered space, which was our office in this case), manages the history
information of the places and times it found objects and/or persons, and te
lls the user, indicating their three-dimensional positions with line of sig
ht and its finger. It interactively learns new objects and persons together
with their names and owners. By using this function, the robot can engage
in simple dialogue (do a task) with the user.