Construct Invalidity Comes from Method Effects
- 1 June 1987
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 47 (2) , 285-307
- https://doi.org/10.1177/0013164487472001
Abstract
Method effects are the sources of the construct invalidity in social-behavioral measuring procedures. Some method effects come from inadequacies in the protocol-the sequence of behaviors that is selected and identified solely by the set of conditions under which it occurs. The protocol may be inappropriate to the construct as specified or it may be insufficient because its conditions restrict the range of possible manifestations of construct-relevant behavior. Other method effects are technique effects-errors of commission occurring when a measuring operation is applied to a protocol. These errors may come from the actor's reactions to being measured, from the data-producer, or from the instrument used by the data-producer. Although detecting the presence of method effects is relatively easy, identifying specific effects is more difficult. Such identification usually requires the rescoring or recoding of the data on attributes suspected of contributing systematic but unwanted effects. Method effects also can arise from interactions among such conceptually irrelevant variables or between one of them and the construct of interest. When investigators can understand and improve their methods, they can more adequately understand and interpret their empirical findings.Keywords
This publication has 12 references indexed in Scilit:
- Ubiquitous halo.Psychological Bulletin, 1981
- The frequency concept of disposition: dominance and prototypically dominant acts1Journal of Personality, 1980
- The nature of mental abilities.American Psychologist, 1979
- Telling more than we can know: Verbal reports on mental processes.Psychological Review, 1977
- Stability of Response Process and ResponseEducational and Psychological Measurement, 1974
- Response Processes and Relative Location of Subject and ItemEducational and Psychological Measurement, 1973
- Comparison of strategies in developing scales for dominance.Psychological Bulletin, 1968
- The Experimental Conditions for Measuring Individual DifferencesEducational and Psychological Measurement, 1963
- The reliability of a response measure: Differential recognition-threshold scores.Psychological Bulletin, 1962
- Construct validity in psychological tests.Psychological Bulletin, 1955