A Comparison of Bayes Factor Approximation Methods Including Two New Methods
- 1 May 2012
- journal article
- Published by SAGE Publications in Sociological Methods & Research
- Vol. 41 (2) , 294-324
- https://doi.org/10.1177/0049124112452393
Abstract
Bayes factors (BFs) play an important role in comparing the fit of statistical models. However, computational limitations or lack of an appropriate prior sometimes prevent researchers from using exact BFs. Instead, it is approximated, often using the Bayesian Information Criterion (BIC) or a variant of BIC. The authors provide a comparison of several BF approximations, including two new approximations, the Scaled Unit Information Prior Bayesian Information Criterion (SPBIC) and Information matrix-based Bayesian Information Criterion (IBIC). The SPBIC uses a scaled unit information prior that is more general than the BIC’s unit information prior, and the IBIC utilizes more terms of approximation than the BIC. Through simulation, the authors show that several measures perform well in large samples, that performance declines in smaller samples, and that SPBIC and IBIC provide improvement to existing measures under some conditions, including small sample sizes. The authors illustrate the use of the fit measures with the crime data of Ehrlich and then conclude with recommendations for researchers.Keywords
This publication has 26 references indexed in Scilit:
- Multimodel InferenceSociological Methods & Research, 2004
- Introduction to the Special Issue on Model SelectionSociological Methods & Research, 2004
- A Critique of the Bayesian Information Criterion for Model SelectionSociological Methods & Research, 1999
- Editor's Introduction to the Special Issue on the Bayesian Information CriterionSociological Methods & Research, 1999
- Information and other criteria in structural equation model selectionCommunications in Statistics - Simulation and Computation, 1997
- Bayes FactorsJournal of the American Statistical Association, 1995
- On the Choice of a Model to Fit Data from an Exponential FamilyThe Annals of Statistics, 1988
- Accurate Approximations for Posterior Moments and Marginal DensitiesJournal of the American Statistical Association, 1986
- Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher informationBiometrika, 1978
- Estimating the Dimension of a ModelThe Annals of Statistics, 1978