Assessing respondent-driven sampling
Top Cited Papers
- 29 March 2010
- journal article
- research article
- Published by Proceedings of the National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 107 (15) , 6743-6747
- https://doi.org/10.1073/pnas.1000261107
Abstract
Respondent-driven sampling (RDS) is a network-based technique for estimating traits in hard-to-reach populations, for example, the prevalence of HIV among drug injectors. In recent years RDS has been used in more than 120 studies in more than 20 countries and by leading public health organizations, including the Centers for Disease Control and Prevention in the United States. Despite the widespread use and growing popularity of RDS, there has been little empirical validation of the methodology. Here we investigate the performance of RDS by simulating sampling from 85 known, network populations. Across a variety of traits we find that RDS is substantially less accurate than generally acknowledged and that reported RDS confidence intervals are misleadingly narrow. Moreover, because we model a best-case scenario in which the theoretical RDS sampling assumptions hold exactly, it is unlikely that RDS performs any better in practice than in our simulations. Notably, the poor performance of RDS is driven not by the bias but by the high variance of estimates, a possibility that had been largely overlooked in the RDS literature. Given the consistency of our results across networks and our generous sampling conditions, we conclude that RDS as currently practiced may not be suitable for key aspects of public health surveillance where it is now extensively applied.Keywords
This publication has 42 references indexed in Scilit:
- 7. Respondent-Driven Sampling: An Assessment of Current MethodologySociological Methodology, 2010
- Evaluating Respondent-Driven Sampling in a Major Metropolitan Area: Comparing Injection Drug Users in the 2005 Seattle Area National HIV Behavioral Surveillance System Survey with Participants in the RAVEN and Kiwi StudiesAnnals of Epidemiology, 2010
- Using Respondent-Driven Sampling in a Hidden Population at Risk of HIV Infection: Who Do HIV-Positive Recruiters Recruit?Sexually Transmitted Diseases, 2009
- 3. An Empirical Test of Respondent-Driven Sampling: Point Estimates, Variance, Degree Measures, and Out-of-Equilibrium DataSociological Methodology, 2009
- Respondent‐driven sampling as Markov chain Monte CarloStatistics in Medicine, 2009
- Methods to Recruit Hard-to-Reach Groups: Comparing Two Chain Referral Sampling Methods of Recruiting Injecting Drug Users Across Nine Studies in Russia and EstoniaJournal of Urban Health, 2006
- Respondent-Driven Sampling of Injection Drug Users in Two U.S.–Mexico Border Cities: Recruitment Dynamics and Impact on Estimates of HIV and Syphilis PrevalenceJournal of Urban Health, 2006
- Variance Estimation, Design Effects, and Sample Size Calculations for Respondent-Driven SamplingJournal of Urban Health, 2006
- Recruiting Injection Drug Users: A Three-Site Comparison of Results and Experiences with Respondent-Driven and Targeted Sampling ProceduresJournal of Urban Health, 2006
- Effectiveness of Respondent-Driven Sampling for Recruiting Drug Users in New York City: Findings from a Pilot StudyJournal of Urban Health, 2006