Markov Chain Monte Carlo Methods for Computing Bayes Factors
- 1 September 2001
- journal article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 96 (455) , 1122-1132
- https://doi.org/10.1198/016214501753208780
Abstract
The problem of calculating posterior probabilities for a collection of competing models and associated Bayes factors continues to be a formidable challenge for applied Bayesian statisticians. Current approaches that take advantage of modern Markov chain Monte Carlo computing methods include those that attempt to sample over some form of the joint space created by the model indicators and the parameters for each model, others that sample over the model space alone, and still others that attempt to estimate the marginal likelihood of each model directly (because the collection of these is equivalent to the collection of model probabilities themselves). We review several methods and compare them in the context of three examples: a simple regression example, a more challenging hierarchical longitudinal model, and a binary data latent variable model. We find that the joint model-parameter space search methods perform adequately but can be difficult to program and tune, whereas the marginal likelihood methods o...Keywords
This publication has 25 references indexed in Scilit:
- On the Relationship Between Markov chain Monte Carlo Methods for Model UncertaintyJournal of Computational and Graphical Statistics, 2001
- Marginal Likelihood From the Metropolis–Hastings OutputJournal of the American Statistical Association, 2001
- On MCMC sampling in hierarchical longitudinal modelsStatistics and Computing, 1999
- Analysis of multivariate probit modelsBiometrika, 1998
- Model choice: a minimum posterior predictive loss approachBiometrika, 1998
- Prediction Via Orthogonalized Model MixingJournal of the American Statistical Association, 1996
- Marginal Likelihood from the Gibbs OutputJournal of the American Statistical Association, 1995
- A Comparative Trial of Didanosine or Zalcitabine after Treatment with Zidovudine in Patients with Human Immunodeficiency Virus InfectionNew England Journal of Medicine, 1994
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- Sampling-Based Approaches to Calculating Marginal DensitiesJournal of the American Statistical Association, 1990