Rates of convergence of the Hastings and Metropolis algorithms
Open Access
- 1 February 1996
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 24 (1) , 101-121
- https://doi.org/10.1214/aos/1033066201
Abstract
We apply recent results in Markov chain theory to Hastings and Metropolis algorithms with either independent or symmetric candidate distributions, and provide necessary and sufficient conditions for the algorithms to converge at a geometric rate to a prescribed distribution $\pi$. In the independence case (in $\mathbb{R}^k$) these indicate that geometric convergence essentially occurs if and only if the candidate density is bounded below by a multiple of $\pi$; in the symmetric case (in $\mathbb{R}$ only) we show geometric convergence essentially occurs if and only if $\pi$ has geometric tails. We also evaluate recently developed computable bounds on the rates of convergence in this context: examples show that these theoretical bounds can be inherently extremely conservative, although when the chain is stochastically monotone the bounds may well be effective.
Keywords
This publication has 19 references indexed in Scilit:
- Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithmsBiometrika, 1996
- Minorization Conditions and Convergence Rates for Markov Chain Monte CarloJournal of the American Statistical Association, 1995
- Bayesian Computation and Stochastic SystemsStatistical Science, 1995
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- Computable Bounds for Geometric Convergence Rates of Markov ChainsThe Annals of Applied Probability, 1994
- Subgeometric Rates of Convergence of f-Ergodic Markov ChainsAdvances in Applied Probability, 1994
- Asymptotic Behavior of the Gibbs SamplerJournal of the American Statistical Association, 1993
- On the Convergence of Successive Substitution SamplingJournal of Computational and Graphical Statistics, 1992
- Bayesian Statistics without Tears: A Sampling-Resampling PerspectiveThe American Statistician, 1992
- Monte Carlo sampling methods using Markov chains and their applicationsBiometrika, 1970