Methods for Testing and Evaluating Survey Questions
Top Cited Papers
Open Access
- 1 March 2004
- journal article
- research article
- Published by Oxford University Press (OUP) in Public Opinion Quarterly
- Vol. 68 (1) , 109-130
- https://doi.org/10.1093/poq/nfh008
Abstract
An examination of survey pretesting reveals a paradox. On the one hand, pretesting is the only way to evaluate in advance whether a questionnaire causes problems for interviewers or respondents. Consequently, both elementary textbooks and experienced researchers declare pretesting indispensable. On the other hand, most textbooks offer minimal, if any, guidance about pretesting methods, and published survey reports usually provide no information about whether questionnaires were pretested and, if so, how, and with what results. Moreover, until recently there was relatively little methodological research on pretesting. Thus pretesting’s universally acknowledged importance has been honored more in the breach than in the practice, and not a great deal is known about many aspects of pretesting, including the extent to which pretests serve their intended purpose and lead to improved questionnaires.Keywords
This publication has 7 references indexed in Scilit:
- The Science of Asking QuestionsAnnual Review of Sociology, 2003
- Construct Validity and Error Components of Survey Measures: A Structural Modeling ApproachPublic Opinion Quarterly, 1984
- The Pretest in Survey Research: Issues and Preliminary FindingsJournal of Marketing Research, 1982
- Verbal reports as data.Psychological Review, 1980
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959
- Three Criteria: Knowledge, Conviction, and SignificancePublic Opinion Quarterly, 1940
- Pretesting of QuestionnairesAmerican Sociological Review, 1940