Abstract
We investigate how sequential decision processes can be solved, under act-state independence. We first identify a reasonable requirement that such solutions ought to satisfy under act-state independence, which we call locality. We then identify a simple necessary and sufficient algebraic condition on choice functions for locality to be satisfied. As an example, we study locality for some choice functions used in imprecise probability theory, and find that marginal extension plays a crucial role.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ben-Haim, Y.: Info-Gap Decision Theory. Academic Press, London (2001)
Dempster, A.P.: Upper and lower probabilities induced by a multivalued mapping. The Annals of Mathematical Statistics 38, 325–339 (1967)
Dubins, L.E.: Finitely additive conditional probabilities, conglomerability and disintegrations. The Annals of Probability 3(1), 89–99 (1975)
Huntley, N., Troffaes, M.C.M.: Subtree perfectness, backward induction, and normal-extensive form equivalence for single agent sequential decision making under arbitrary choice functions (submitted)
Kolmogorov, A.N.: Foundations of the Theory of Probability. Chelsea Publishing Company, New York (1950)
Miranda, E.: A survey of the theory of coherent lower previsions. International Journal of Approximate Reasoning 48(2), 628–658 (2008)
Selten, R.: Reexamination of the perfectness concept for equilibrium points in extensive games. International Journal of Game Theory 4(1), 25–55 (1975)
Sen, A.: Social choice theory: A re-examination. Econometrica 45(1), 53–89 (1977)
Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton (1976)
Shafer, G., Vovk, V.: Probability and Finance: It’s Only a Game! Wiley, New York (2001)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Troffaes, M.C.M.: Finite approximations to coherent choice. International Journal of Approximate Reasoning 50(4), 655–665 (2009)
Walley, P.: Statistical Reasoning with Imprecise Probabilities. Chapman & Hall, Boca Raton (1991)
Walley, P.: Inferences from multinomial data: Learning about a bag of marbles. Journal of the Royal Statistical Society. Series B 58(1), 3–57 (1996)
Williams, P.M.: Notes on conditional previsions. Technical report, School of Math. and Phys. Sci., Univ. of Sussex (1975); Reprinted in International Journal of Approximate Reasoning 44(3), 366–383 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Troffaes, M.C.M., Huntley, N., Filho, R.S. (2010). Sequential Decision Processes under Act-State Independence with Arbitrary Choice Functions. In: Hüllermeier, E., Kruse, R., Hoffmann, F. (eds) Information Processing and Management of Uncertainty in Knowledge-Based Systems. Theory and Methods. IPMU 2010. Communications in Computer and Information Science, vol 80. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14055-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-14055-6_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14054-9
Online ISBN: 978-3-642-14055-6
eBook Packages: Computer ScienceComputer Science (R0)