VIRTUAL SPACE TELECONFERENCING - REAL-TIME REPRODUCTION OF 3D HUMAN IMAGES

Real-time reproduction of 3D human images is realized by an experiment al system recently built as a prototype for virtual space teleconferen cing, in which participants at different sites can feel as if they are colocated and can work cooperatively, At each sending and receiving s ite of the teleconferencing system, a 3D model of each participant is constructed from a wire frame model mapped by color texture and is ren dered on a 3D display, In the current experimental system, real-time d etection of facial features at the sending site is achieved by visuall y tracking tape marks pasted to the participant's face. Movements of t he head, body, hands, and fingers are detected in real time using magn etic sensors and data gloves. At the receiving site, the detected moti on parameters are used to move nodes in the wire frame model to reprod uce the movements of the participants at each sending site. Realistic facial expressions are reproduced through the-use of simple motion rul es applied to the tape mark tracking information, Through experimental evaluation, the optimal number of nodes for best quality has been obt ained. Reproduction of facial expressions and synthesis of arm movemen ts are examined, The reproduction speed using the optimal human model is approximately 6 frames/s. Examples of cooperative work by participa nts using the experimental system illustrate the effectiveness of virt ual space teleconferencing. (C) 1995 Academic Press, Inc.