Almost stationary epsilon-equilibria in zero-sum stochastic games

J Flesch, F Thuijsman, OJ Vrieze

Research output: Contribution to journalArticleAcademicpeer-review

44 Downloads (Pure)


We show the existence of almost stationary epsilon-equilibria, for all epsilon > 0, in zero-sum stochastic games with finite state and action spaces. These are E-equilibria with the property that, if neither player deviates, then stationary strategies are played forever with probability almost 1. The proof is based on the construction of specific stationary strategy pairs, with corresponding rewards equal to the value, which can be supplemented with history-dependent delta-optimal strategies, with small delta > 0, in order to obtain almost stationary epsilon-equilibria.
Original languageEnglish
Pages (from-to)371-389
JournalJournal of Optimization Theory and Applications
Issue number2
Publication statusPublished - May 2000


  • zero-sum stochastic games
  • limiting average rewards
  • equilibria


Dive into the research topics of 'Almost stationary epsilon-equilibria in zero-sum stochastic games'. Together they form a unique fingerprint.

Cite this