Almost stationary epsilon-equilibria in zero-sum stochastic games

J Flesch, F Thuijsman, OJ Vrieze

Research output: Contribution to journalArticleAcademicpeer-review

2 Citations (Web of Science)
25 Downloads (Pure)


We show the existence of almost stationary epsilon-equilibria, for all epsilon > 0, in zero-sum stochastic games with finite state and action spaces. These are E-equilibria with the property that, if neither player deviates, then stationary strategies are played forever with probability almost 1. The proof is based on the construction of specific stationary strategy pairs, with corresponding rewards equal to the value, which can be supplemented with history-dependent delta-optimal strategies, with small delta > 0, in order to obtain almost stationary epsilon-equilibria.
Original languageEnglish
Pages (from-to)371-389
JournalJournal of Optimization Theory and Applications
Issue number2
Publication statusPublished - May 2000


  • zero-sum stochastic games
  • limiting average rewards
  • equilibria

Cite this