Problems in Examining the Validity of the ACTFL Oral Proficiency Interview
- 1 June 1988
- journal article
- research article
- Published by Cambridge University Press (CUP) in Studies in Second Language Acquisition
- Vol. 10 (2) , 149-164
- https://doi.org/10.1017/s0272263100007282
Abstract
The primary problems in measuring speaking ability through an oral interview procedure are not those related to efficiency or reliability, but rather those associated with examining the validity of the interview ratings as measures of ability in speaking and of the uses that are made of such ratings. In order to examine all aspects of validity, the abilities measured must be clearly distinguished from the elicitation procedures, in both the design of the interview and in the interpretation of ratings.Research from applied linguistics and language testing is consistent with the position that language proficiency consists of several distinct but related abilities. Research from language testing also indicates that the methods used to measure language ability have an important effect on test performance. Two frameworks—one of communicative language ability and the other of test method facets—are proposed as a basis for distinguishing abilities from elicitation procedures and for informing a program of empirical research and development.The validity of the ACTFL Oral Proficiency Interview (OPI) as it is currently designed and used cannot be adequately examined, much less demonstrated, because it confounds abilities with elicitation procedures in its design, and it provides only a single rating, which has no basis in either theory or research. As test developer, ACTFL has yet to fully discharge its responsibility for providing sufficient evidence of validity to support uses that are made of OPI ratings.Keywords
This publication has 19 references indexed in Scilit:
- The Measurement of Foreign/Second Language ProficiencyThe Annals of the American Academy of Political and Social Science, 1987
- Assessing Speaking Proficiency in the Undergraduate Curriculum: Data from FrenchForeign Language Annals, 1986
- Proficiency: Panacea, Framework, Process? A Reply to Kramsch, Schulz, and, Particularly, to Bachman and SavignonThe Modern Language Journal, 1986
- The Evaluation of Communicative Language Proficiency: A Critique of the ACTFL Oral InterviewThe Modern Language Journal, 1986
- The Meaning of Content ValidityApplied Psychological Measurement, 1983
- A Sampling Model for ValidityApplied Psychological Measurement, 1982
- Evidence and Ethics in the Evaluation of TestsEducational Researcher, 1981
- Constructs and their vicissitudes in educational and psychological measurement.Psychological Bulletin, 1981
- Issues of Validity for Criterion-Referenced MeasuresApplied Psychological Measurement, 1980
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959