Marginal Likelihood and Bayes Factors for Dirichlet Process Mixture Models
- 1 March 2003
- journal article
- Published by Taylor & Francis in Journal of the American Statistical Association
- Vol. 98 (461) , 224-235
- https://doi.org/10.1198/01621450338861947
Abstract
We present a method for comparing semiparametric Bayesian models, constructed under the Dirichlet process mixture (DPM) framework, with alternative semiparameteric or parameteric Bayesian models. A distinctive feature of the method is that it can be applied to semiparametric models containing covariates and hierarchical prior structures, and is apparently the first method of its kind. Formally, the method is based on the marginal likelihood estimation approach of Chib (1995) and requires estimation of the likelihood and posterior ordinates of the DPM model at a single high-density point. An interesting computation is involved in the estimation of the likelihood ordinate, which is devised via collapsed sequential importance sampling. Extensive experiments with synthetic and real data involving semiparametric binary data regression models and hierarchical longitudinal mixed-effects models are used to illustrate the implementation, performance, and applicability of the method.Keywords
This publication has 29 references indexed in Scilit:
- Bayesian and Conditional Frequentist Testing of a Parametric Model Versus Nonparametric AlternativesJournal of the American Statistical Association, 2001
- Marginal Likelihood From the Metropolis–Hastings OutputJournal of the American Statistical Association, 2001
- On MCMC sampling in hierarchical longitudinal modelsStatistics and Computing, 1999
- A semiparametric Bayesian model for randomised block designsBiometrika, 1996
- Marginal Likelihood from the Gibbs OutputJournal of the American Statistical Association, 1995
- Understanding the Metropolis-Hastings AlgorithmThe American Statistician, 1995
- Bayesian Density Estimation and Inference Using MixturesJournal of the American Statistical Association, 1995
- Estimating Normal Means with a Dirichlet Process PriorJournal of the American Statistical Association, 1994
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- Ferguson Distributions Via Polya Urn SchemesThe Annals of Statistics, 1973