This paper presents a symbolic formalism for modeling and retrieving video
data via the moving objects contained in the video images. The model integr
ates the representations of individual moving objects in a scene with the t
ime-varying relationships between them by incorporating both the notions of
object tracks and temporal sequences of PIRs (projection interval relation
ships). The model is supported by a set of operations which form the basis
of a moving object algebra. This algebra allows one to retrieve scenes and
information from scenes by specifying both spatial and temporal properties
of the objects involved. It also provides operations to create new scenes f
rom existing ones. A prototype implementation is described which allows que
ries to be specified either via an animation sketch or using the moving obj
ect algebra.