Batch means and spectral variance estimators in Markov chain Monte Carlo
Top Cited Papers
Open Access
- 1 April 2010
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 38 (2) , 1034-1070
- https://doi.org/10.1214/09-aos735
Abstract
Calculating a Monte Carlo standard error (MCSE) is an important step in the statistical analysis of the simulation output obtained from a Markov chain Monte Carlo experiment. An MCSE is usually based on an estimate of the variance of the asymptotic normal distribution. We consider spectral and batch means methods for estimating this variance. In particular, we establish conditions which guarantee that these estimators are strongly consistent as the simulation effort increases. In addition, for the batch means and overlapping batch means methods we establish conditions ensuring consistency in the mean-square sense which in turn allows us to calculate the optimal batch size up to a constant of proportionality. Finally, we examine the empirical finite-sample properties of spectral variance and batch means estimators and provide recommendations for practitioners.Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- Markov Chain Monte Carlo: Can We Trust the Third Significant Figure?Statistical Science, 2008
- A Few Remarks on “Fixed-Width Output Analysis for Markov Chain Monte Carlo” by Jones et alJournal of the American Statistical Association, 2007
- Convergence Rates and Asymptotic Standard Errors for Markov Chain Monte Carlo Algorithms for Bayesian Probit RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2007
- Fixed-Width Output Analysis for Markov Chain Monte CarloJournal of the American Statistical Association, 2006
- On the central limit theorem for geometrically ergodic Markov chainsProbability Theory and Related Fields, 2004
- Geometric Ergodicity of van Dyk and Meng's Algorithm for the Multivariate Student'stModelJournal of the American Statistical Association, 2004
- Minorization Conditions and Convergence Rates for Markov Chain Monte CarloJournal of the American Statistical Association, 1995
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- Estimating the asymptotic variance with batch meansOperations Research Letters, 1991
- Almost sure invariance principles for partial sums of weakly dependent random variablesMemoirs of the American Mathematical Society, 1975