A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD Survey
- 1 February 2004
- journal article
- other
- Published by SAGE Publications in Social Science Computer Review
- Vol. 22 (1) , 128-138
- https://doi.org/10.1177/0894439303256551
Abstract
The authors conducted a large-scale survey about health care twice, once as a web and once as a random digit dialing (RDD) phone survey. The web survey used a statistical technique, propensity scoring, to adjust for selection bias. Comparing the weighted responses from both surveys, there were no significant response differences in 8 of 37 questions. Web survey responses were significantly more likely to agree with RDD responses when the question asked about the respondent’s personal health (9 times more likely), was a factual question (9 times more likely), and only had two as opposed to multiple response categories (17 times more likely). For three questions, significant differences turned insignificant when adjacent categories of multicategory questions were combined. Factual questions tended to also be questions with two rather than multiple response categories. More study is needed to isolate the effects of these two factors more clearly.Keywords
This publication has 12 references indexed in Scilit:
- Survey Administration Effects?Social Science Computer Review, 2003
- Web Surveys as Part of a Mixed-Mode Strategy for Populations that cannot be Contacted by E-MailSocial Science Computer Review, 2003
- Advantages and Disadvantages of Internet Research Surveys: Evidence from the LiteratureField Methods, 2002
- Observational StudiesPublished by Springer Nature ,2002
- The Psychology of Survey ResponsePublished by Cambridge University Press (CUP) ,2000
- Does Internet Research Work?International Journal of Market Research, 2000
- Development of a Standard E-Mail Methodology: Results of an ExperimentPublic Opinion Quarterly, 1998
- Reducing Bias in Observational Studies Using Subclassification on the Propensity ScoreJournal of the American Statistical Association, 1984
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983
- Respondent Selection in a Telephone Survey: A Comparison of Three TechniquesJournal of Marketing Research, 1982