Reversible Jump, Birth-and-Death and More General Continuous Time Markov Chain Monte Carlo Samplers
Open Access
- 8 July 2003
- journal article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 65 (3) , 679-700
- https://doi.org/10.1111/1467-9868.00409
Abstract
Summary: Reversible jump methods are the most commonly used Markov chain Monte Carlo tool for exploring variable dimension statistical models. Recently, however, an alternative approach based on birth-and-death processes has been proposed by Stephens for mixtures of distributions. We show that the birth-and-death setting can be generalized to include other types of continuous time jumps like split-and-combine moves in the spirit of Richardson and Green. We illustrate these extensions both for mixtures of distributions and for hidden Markov models. We demonstrate the strong similarity of reversible jump and continuous time methodologies by showing that, on appropriate rescaling of time, the reversible jump chain converges to a limiting continuous time birth-and-death process. A numerical comparison in the setting of mixtures of distributions highlights this similarity.This publication has 19 references indexed in Scilit:
- Estimating Mixtures of RegressionsJournal of Computational and Graphical Statistics, 2003
- Markov Chain Monte Carlo: 10 Years and Still Running!Journal of the American Statistical Association, 2000
- Computational and Inferential Difficulties with Mixture Posterior DistributionsJournal of the American Statistical Association, 2000
- Bayesian analysis of mixture models with an unknown number of components—an alternative to reversible jump methodsThe Annals of Statistics, 2000
- Bayesian Inference in Hidden Markov Models Through the Reversible Jump Markov Chain Monte Carlo MethodJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- Convergence controls for MCMC algorithms, with applications to hidden markov chainsJournal of Statistical Computation and Simulation, 1999
- On White Noises Driven by Hidden Markov ChainsJournal of Time Series Analysis, 1997
- Rao-Blackwellisation of sampling schemesBiometrika, 1996
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determinationBiometrika, 1995
- Density Estimation with Confidence Sets Exemplified by Superclusters and Voids in the GalaxiesJournal of the American Statistical Association, 1990