THE CONCEPT OF DYNAMIC CRITERIA: A CRITICAL REANALYSIS
- 1 March 1985
- journal article
- Published by Wiley in Personnel Psychology
- Vol. 38 (1) , 41-56
- https://doi.org/10.1111/j.1744-6570.1985.tb00540.x
Abstract
Discussions of “the criterion problem” stress the assumedly frequent incidence of dynamic criteria. However, different concepts of dynamic criteria have not been distinguished. Three views of dynamic criteria are clarified in this paper. These are dynamic criteria conceptualized as (a) changes in group average performance over time, (b) changes in validity over time, and (c) changes in the rank‐ordering of scores on the criterion over time. The evidence cited for each concept of dynamic criteria is critically analyzed and submitted to significance tests. The results of analyses of 735 r's and 532 paired r's across time from studies pertinent to dynamic criteria are reported. It is concluded that dynamic criteria are rare phenomena, with the significant changes found in key studies explainable by methodological artifacts. Though many sources suggest that dynamic criteria have dire consequences for the overall selection process, we argue that the phenomena have been over‐emphasized in the literature, and that practitioners' concern should focus instead on removing sources of criterion unreliability.Keywords
This publication has 51 references indexed in Scilit:
- Imposed quotas and personnel selection: A computer simulation study.Journal of Applied Psychology, 1983
- The stability of behavior: I. On predicting most of the people much of the time.Journal of Personality and Social Psychology, 1979
- A Multitrait-Multirater Analysis of a Behaviorally- Anchored Rating Scale for Sales PersonnelApplied Psychological Measurement, 1977
- Organization DevelopmentAnnual Review of Psychology, 1974
- Comparison of Tests of the Equality of Dependent Correlation CoefficientsJournal of the American Statistical Association, 1971
- Signs, samples, and criteria.Journal of Applied Psychology, 1968
- The assessment of performance change: An inductive exampleOrganizational Behavior and Human Performance, 1967
- Prediction of success from examination of performance during the training period.Journal of Applied Psychology, 1956
- The Theory and Classification of Criterion BiasEducational and Psychological Measurement, 1950
- Learning in accident reduction.Journal of Applied Psychology, 1947