Multiprocess parallel antithetic coupling for backward and forward Markov Chain Monte Carlo
Open Access
- 1 April 2005
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 33 (2)
- https://doi.org/10.1214/009053604000001075
Abstract
Antithetic coupling is a general stratification strategy for reducing Monte Carlo variance without increasing the simulation size. The use of the antithetic principle in the Monte Carlo literature typically employs two strata via antithetic quantile coupling. We demonstrate here that further stratification, obtained by using k>2 (e.g., k=3-10) antithetically coupled variates, can offer substantial additional gain in Monte Carlo efficiency, in terms of both variance and bias. The reason for reduced bias is that antithetically coupled chains can provide a more dispersed search of the state space than multiple independent chains. The emerging area of perfect simulation provides a perfect setting for implementing the k-process parallel antithetic coupling for MCMC because, without antithetic coupling, this class of methods delivers genuine independent draws. Furthermore, antithetic backward coupling provides a very convenient theoretical tool for investigating antithetic forward coupling. However, the generation of k>2 antithetic variates that are negatively associated, that is, they preserve negative correlation under monotone transformations, and extremely antithetic, that is, they are as negatively correlated as possible, is more complicated compared to the case with k=2. In this paper, we establish a theoretical framework for investigating such issues. Among the generating methods that we compare, Latin hypercube sampling and its iterative extension appear to be general-purpose choices, making another direct link between Monte Carlo and quasi Monte Carlo.Comment: Published at http://dx.doi.org/10.1214/009053604000001075 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.orgKeywords
All Related Versions
This publication has 54 references indexed in Scilit:
- Latin hypercube sampling and the propagation of uncertainty in analyses of complex systemsReliability Engineering & System Safety, 2003
- Gibbs Sampling for Bayesian Non-Conjugate and Hierarchical Models by Using Auxiliary VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 1999
- Perfect simulation and backward coupling∗Communications in Statistics. Stochastic Models, 1998
- Monte Carlo Variance of Scrambled Net QuadratureSIAM Journal on Numerical Analysis, 1997
- Bayesian Inference of Survival Probabilities, under Stochastic Ordering ConstraintsJournal of the American Statistical Association, 1996
- Statistical sampling and fractal distributionsThe Mathematical Intelligencer, 1996
- Bayesian Analysis of Binary and Polychotomous Response DataJournal of the American Statistical Association, 1993
- Bayesian Analysis of Constrained Parameter and Truncated Data Problems Using Gibbs SamplingJournal of the American Statistical Association, 1992
- Large Sample Properties of Simulations Using Latin Hypercube SamplingTechnometrics, 1987
- Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output from a Computer CodeTechnometrics, 1979