Development and Refinement of a Measure for Assessing the Acceptability of Assessment Methods: The Assessment Rating Profile-Revised
- 1 December 1999
- journal article
- Published by SAGE Publications in Canadian Journal of School Psychology
- Vol. 15 (1) , 21-42
- https://doi.org/10.1177/082957359901500103
Abstract
This paper describes the development and psychometric properties of the Assessment Rating Profile-Revised (ARP-R), an instrument designed to evaluate the acceptability of assessment methods. First, an overview of the initial exploratory work on the original scale, the Assessment Rating Profile (APR; Kratochwill & Van Someren, 1984), is provided. Research examining the reliability and validity of the ARP is reviewed and psychometric inadequacies are highlighted. Next, the results of a study examining the psychometric properties of the revised measure are reported. The results of the study indicated that the ARP-R demonstrated good internal consistency, with coefficients ranging from .94 to .99. Test-retest reliability across 1-, 3-, 6-, and 12-month intervals rangedfrom .82 to .85, suggesting adequate stability over time. Confirmatory factor analytic procedures indicated a reasonable fit of the data to the proposed one-factor model, “General Assessment Acceptability.” Lastly, suggestions are made regarding use of the ARP-R in applied and research settings.Keywords
This publication has 44 references indexed in Scilit:
- A Monte Carlo Study of Constrained Factor Analysis Using Maximum Likelihood and Unweighted Least SquaresEducational and Psychological Measurement, 1995
- Teachers' Preferences for Academic Intervention Strategies in Mathematics: Implications for Instructional ConsultationJournal of Educational and Psychological Consultation, 1995
- The Interplay of Evidence and Consequences in the Validation of Performance AssessmentsEducational Researcher, 1994
- Treatment acceptability of symptom prescription techniques.Journal of Counseling Psychology, 1993
- Acceptability of Treatments for Child Behavioral DisturbanceChild & Family Behavior Therapy, 1992
- Can test statistics in covariance structure analysis be trusted?Psychological Bulletin, 1992
- Variables influencing perceptions of liability: A case for treatment acceptability assessment.School Psychology Quarterly, 1990
- Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size.Psychological Bulletin, 1988
- "How Big Is Big Enough?": Sample Size and Goodness of Fit in Structural Equation Models with Latent VariablesChild Development, 1987
- Teacher judgments concerning the acceptability of school-based interventions.Professional Psychology: Research and Practice, 1985