[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

Concurrent games with tail objectives

Published: 01 December 2007 Publication History

Abstract

We study infinite stochastic games played by two players over a finite state space, with objectives specified by sets of infinite traces. The games are concurrent (players make moves simultaneously and independently), stochastic (the next state is determined by a probability distribution that depends on the current state and chosen moves of the players) and infinite (proceed for an infinite number of rounds). The analysis of concurrent stochastic games can be classified into: quantitative analysis, analyzing the optimum value of the game and @e-optimal strategies that ensure values within @e of the optimum value; and qualitative analysis, analyzing the set of states with optimum value 1 and @e-optimal strategies for the states with optimum value 1. We consider concurrent games with tail objectives, i.e., objectives that are independent of the finite-prefix of traces, and show that the class of tail objectives is strictly richer than that of the @w-regular objectives. We develop new proof techniques to extend several properties of concurrent games with @w-regular objectives to concurrent games with tail objectives. We prove the positive limit-one property for tail objectives. The positive limit-one property states that for all concurrent games if the optimum value for a player is positive for a tail objective @F at some state, then there is a state where the optimum value is 1 for the player for the objective @F. We also show that the optimum values of zero-sum (strictly conflicting objectives) games with tail objectives can be related to equilibrium values of nonzero-sum (not strictly conflicting objectives) games with simpler reachability objectives. A consequence of our analysis presents a polynomial time reduction of the quantitative analysis of tail objectives to the qualitative analysis for the subclass of one-player stochastic games (Markov decision processes).

References

[1]
Chatterjee, K., de Alfaro, L. and Henzinger, T.A., Trading memory for randomness. In: QEST¿04, IEEE Computer Society Press. pp. 206-217.
[2]
Chatterjee, K., de Alfaro, L. and Henzinger, T.A., The complexity of quantitative concurrent parity games. In: SODA¿06, SIAM.
[3]
Condon, A., The complexity of stochastic games. Information and Computation. v96 i2. 203-224.
[4]
Courcoubetis, C. and Yannakakis, M., The complexity of probabilistic verification. Journal of the ACM. v42 i4. 857-907.
[5]
L. de Alfaro, Formal verification of probabilistic systems, Ph.D. Thesis, Stanford University, 1997
[6]
de Alfaro, L. and Henzinger, T.A., Concurrent omega-regular games. In: LICS 00, IEEE Computer Society Press. pp. 141-154.
[7]
de~Alfaro, L. and Majumdar, R., Quantitative solution of omega-regular games. In: STOC 01, ACM Press. pp. 675-683.
[8]
Durrett, Richard, Probability: Theory and Examples. 1995. Duxbury Press.
[9]
Filar, J. and Vrieze, K., Competitive Markov Decision Processes. 1997. Springer-Verlag.
[10]
Nash Jr., J.F., Equilibrium points in n-person games. Proceedings of the National Academy of Sciences USA. v36. 48-49.
[11]
Kechris, A., Classical Descriptive Set Theory. 1995. Springer.
[12]
Martin, D.A., The determinacy of Blackwell games. The Journal of Symbolic Logic. v63 i4. 1565-1581.
[13]
Owen, G., Game Theory. 1995. Academic Press.
[14]
Shapley, L.S., Stochastic games. Proceedings of the National Academy of Sciences USA. v39. 1095-1100.
[15]
Thomas, W., Languages, automata, and logic. In: Handbook of Formal Languages, vol. 3. Springer. pp. 389-455.
[16]
von Neumann, J. and Morgenstern, O., Theory of Games and Economic Behavior. 1947. Princeton University Press.
[17]
W.W. Wadge, Reducibility and determinateness of Baire spaces, Ph.D. Thesis, UC Berkeley, 1984

Cited By

View all
  • (2022)Finite-Memory Strategies in POMDPs with Long-Run Average ObjectivesMathematics of Operations Research10.1287/moor.2020.111647:1(100-119)Online publication date: 1-Feb-2022
  • (2017)Percentile queries in multi-dimensional Markov decision processesFormal Methods in System Design10.1007/s10703-016-0262-750:2-3(207-248)Online publication date: 1-Jun-2017
  • (2016)Perfect-Information Stochastic Games with Generalized Mean-Payoff ObjectivesProceedings of the 31st Annual ACM/IEEE Symposium on Logic in Computer Science10.1145/2933575.2934513(247-256)Online publication date: 5-Jul-2016
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Theoretical Computer Science
Theoretical Computer Science  Volume 388, Issue 1-3
December, 2007
341 pages

Publisher

Elsevier Science Publishers Ltd.

United Kingdom

Publication History

Published: 01 December 2007

Author Tags

  1. Concurrent games
  2. Muller objectives
  3. Omega-regular objectives
  4. Tail objectives

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 15 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Finite-Memory Strategies in POMDPs with Long-Run Average ObjectivesMathematics of Operations Research10.1287/moor.2020.111647:1(100-119)Online publication date: 1-Feb-2022
  • (2017)Percentile queries in multi-dimensional Markov decision processesFormal Methods in System Design10.1007/s10703-016-0262-750:2-3(207-248)Online publication date: 1-Jun-2017
  • (2016)Perfect-Information Stochastic Games with Generalized Mean-Payoff ObjectivesProceedings of the 31st Annual ACM/IEEE Symposium on Logic in Computer Science10.1145/2933575.2934513(247-256)Online publication date: 5-Jul-2016
  • (2015)The value 1 problem under finite-memory strategies for concurrent mean-payoff gamesProceedings of the twenty-sixth annual ACM-SIAM symposium on Discrete algorithms10.5555/2722129.2722198(1018-1029)Online publication date: 4-Jan-2015
  • (2015)Qualitative analysis of concurrent mean-payoff gamesInformation and Computation10.1016/j.ic.2015.03.009242:C(2-24)Online publication date: 1-Jun-2015
  • (2015)The complexity of multi-mean-payoff and multi-energy gamesInformation and Computation10.1016/j.ic.2015.03.001241:C(177-196)Online publication date: 1-Apr-2015
  • (2012)The complexity of stochastic Müller gamesInformation and Computation10.1016/j.ic.2011.11.004211(29-48)Online publication date: 1-Feb-2012
  • (2010)Solving simple stochastic tail gamesProceedings of the twenty-first annual ACM-SIAM symposium on Discrete algorithms10.5555/1873601.1873670(847-862)Online publication date: 17-Jan-2010
  • (2010)Quantitative languagesACM Transactions on Computational Logic10.1145/1805950.180595311:4(1-38)Online publication date: 20-Jul-2010
  • (2009)On Omega-Languages Defined by Mean-Payoff ConditionsProceedings of the 12th International Conference on Foundations of Software Science and Computational Structures - Volume 550410.5555/3266641.3266677(333-347)Online publication date: 22-Mar-2009
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media