Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling
Top Cited Papers
Open Access
- 1 February 2005
- journal article
- Published by Institute of Mathematical Statistics in Statistical Science
- Vol. 20 (1) , 50-67
- https://doi.org/10.1214/088342305000000016
Abstract
In the past ten years there has been a dramatic increase of interest in the Bayesian analysis of finite mixture models. This is primarily because of the emergence of Markov chain Monte Carlo (MCMC) methods. While MCMC provides a convenient way to draw inference from complicated statistical models, there are many, perhaps underappreciated, problems associated with the MCMC analysis of mixtures. The problems are mainly caused by the nonidentifiability of the components under symmetric priors, which leads to so-called label switching in the MCMC output. This means that ergodic averages of component specific quantities will be identical and thus useless for inference. We review the solutions to the label switching problem, such as artificial identifiability constraints, relabelling algorithms and label invariant loss functions. We also review various MCMC sampling schemes that have been suggested for mixture models and discuss posterior sensitivity to prior specification.Keywords
This publication has 39 references indexed in Scilit:
- Reversible Jump, Birth-and-Death and More General Continuous Time Markov Chain Monte Carlo SamplersJournal of the Royal Statistical Society Series B: Statistical Methodology, 2003
- Penalized Maximum Likelihood Estimator for Normal MixturesScandinavian Journal of Statistics, 2003
- Hidden Markov Models and Disease MappingJournal of the American Statistical Association, 2002
- Perfect Samplers for Mixtures of DistributionsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- Dealing With Label Switching in Mixture ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- Bayesian Inference in Hidden Markov Models Through the Reversible Jump Markov Chain Monte Carlo MethodJournal of the Royal Statistical Society Series B: Statistical Methodology, 2000
- MCMC Control Spreadsheets for Exponential Mixture EstimationJournal of Computational and Graphical Statistics, 1999
- Bayesian Density Estimation and Inference Using MixturesJournal of the American Statistical Association, 1995
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- Density Estimation with Confidence Sets Exemplified by Superclusters and Voids in the GalaxiesJournal of the American Statistical Association, 1990