Quantitative bounds on convergence of time-inhomogeneous Markov chains
Open Access
- 1 November 2004
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Probability
- Vol. 14 (4)
- https://doi.org/10.1214/105051604000000620
Abstract
Convergence rates of Markov chains have been widely studied in recent years. In particular, quantitative bounds on convergence rates have been studied in various forms by Meyn and Tweedie [Ann. Appl. Probab. 4 (1994) 981-1101], Rosenthal [J. Amer. Statist. Assoc. 90 (1995) 558-566], Roberts and Tweedie [Stochastic Process. Appl. 80 (1999) 211-229], Jones and Hobert [Statist. Sci. 16 (2001) 312-334] and Fort [Ph.D. thesis (2001) Univ. Paris VI]. In this paper, we extend a result of Rosenthal [J. Amer. Statist. Assoc. 90 (1995) 558-566] that concerns quantitative convergence rates for time-homogeneous Markov chains. Our extension allows us to consider f-total variation distance (instead of total variation) and time-inhomogeneous Markov chains. We apply our results to simulated annealing.Comment: Published at http://dx.doi.org/10.1214/105051604000000620 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.orgKeywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Stochastic Optimization: a ReviewInternational Statistical Review, 2002
- Convergence of simulated annealing using Foster-Lyapunov criteriaJournal of Applied Probability, 2001
- Honest Exploration of Intractable Probability Distributions via Markov Chain Monte CarloStatistical Science, 2001
- SMALL AND PSEUDO-SMALL SETS FOR MARKOV CHAINSStochastic Models, 2001
- An Adaptive Metropolis AlgorithmBernoulli, 2001
- Bounds on regeneration times and convergence rates for Markov chainsStochastic Processes and their Applications, 1999
- Rates of convergence of the Hastings and Metropolis algorithmsThe Annals of Statistics, 1996
- Minorization Conditions and Convergence Rates for Markov Chain Monte CarloJournal of the American Statistical Association, 1995
- Computable Bounds for Geometric Convergence Rates of Markov ChainsThe Annals of Applied Probability, 1994
- Monte Carlo sampling methods using Markov chains and their applicationsBiometrika, 1970