This note extends the usual method for finding totally mixed strategy
equilibria in 2 x 2 matrix games to the computation of randomized Mark
ov equilibria in infinite-horizon discrete-time stochastic games. It i
s shown that the method can be applied in the class of separable seque
ntial games with binary action sets when continuation payoffs are mono
tone in each player's own-mixing probabilities. (C) 1996 Academic Pres
s, Inc.