Desirable properties of the infinite histories of a finite-state Marko
v decision process are specified in terms of a finite number of events
represented as omega-regular sets. An infinite history of the process
produces a reward which depends on the properties it satisfies. The a
uthors investigate the existence of optimal policies and provide algor
ithms for the construction of such policies.