Genericity and Markovian behavior in stochastic games

This paper examines Markov perfect equilibria of general, finite state stoc hastic games. Our main result is that the number of such equilibria is fini te for a set of stochastic game payoffs with full Lebesgue measure. We furt her discuss extensions to lower dimensional stochastic games like the alter nating move game.