Positive zero-sum stochastic games with countable state and action spaces

Janos Flesch, Arkadi Predtetchinski*, William Sudderth

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

2 Citations (Web of Science)


A positive zero-sum stochastic game with countable state and action spaces is shown to have a value if, at every state, at least one player has a finite action space. The proof uses transfinite algorithms to calculate the upper and lower values of the game. We also investigate the existence of (epsilon-)optimal strategies in the classes of stationary and Markov strategies.

Original languageEnglish
Pages (from-to)499-516
Number of pages18
JournalApplied Mathematics and Optimization
Issue number2
Early online date1 Nov 2018
Publication statusPublished - 2020


  • Fixed point
  • Markov strategy
  • Tarski fixed point theorem
  • Transfinite algorithm
  • optimal strategy
  • value of the game
  • zero-sum stochastic game
  • Optimal strategy
  • Zero-sum stochastic game
  • Value of the game

Cite this