TOWARDS A MULTIMODAL PERCEPTUAL MODEL

The objective evaluation of the audio performance of nonlinear process es such as data reduction has required the development of a new genera tion of perception-based assessment algorithms. In the future it is ex pected that a large proportion of communications traffic will be wideb and and multimedia. Objective assessment of perceived performance is r equired for optimisation during design, and for commissioning. In deve loping objective techniques to assess multimedia systems it is necessa ry to investigate, and model, the dependencies which exist between aud io and visual perception (other senses may follow). This paper summari ses the background of current perceptual modelling work and reports ea rly progress towards a multisensory perceptual model. An experimental investigation into combined audio/video perception is described and an algorithmic basis for a multisensory perceptual model proposed In the Suture ir is predicted that algorithmic models of perception will be exploited for objective assessment of multimedia systems and by the de livery technology for advanced telepresence applications.