Optimal strategies for repeated games
Open Access
- 1 March 1981
- journal article
- research article
- Published by Cambridge University Press (CUP) in Advances in Applied Probability
- Vol. 13 (02) , 415-428
- https://doi.org/10.1017/s0001867800036090
Abstract
We extend the optimal strategy results of Kelly and Breiman and extend the class of random variables to which they apply from discrete to arbitrary random variables with expectations. Let Fn be the fortune obtained at the nth time period by using any given strategy and let Fn ∗ be the fortune obtained by using the Kelly–Breiman strategy. We show (Theorem 1(i)) that Fn/Fn ∗ is a supermartingale with E(Fn /Fn ∗) ≤ 1 and, consequently, E(lim Fn /Fn ∗) ≤ 1. This establishes one sense in which the Kelly–Breiman strategy is optimal. However, this criterion for ‘optimality’ is blunted by our result (Theorem 1(ii)) that E(Fn/Fn ∗ ) = 1 for many strategies differing from the Kelly–Breiman strategy. This ambiguity is resolved, to some extent, by our result (Theorem 2) that Fn ∗ /Fn is a submartingale with E(Fn ∗ /Fn ) ≤ 1 and E(lim Fn ∗ /Fn ) ≤ 1; and E(Fn ∗ /Fn ) = 1 if and only if at each time period j, 1 ≤ j ≤ n, the strategies leading to Fn and Fn ∗ are ‘the same’.Keywords
This publication has 5 references indexed in Scilit:
- An optimal branching migration processJournal of Applied Probability, 1975
- Technical Note—Comment on “The Random Nature of Stock-Market Prices” Authored by Barrett and WrightOperations Research, 1975
- Optimal Gambling Systems for Favorable GamesRevue de l'Institut International de Statistique / Review of the International Statistical Institute, 1969
- Criteria for Choice Among Risky VenturesJournal of Political Economy, 1959
- A New Interpretation of Information RateBell System Technical Journal, 1956