Psychometrics Is Datametrics: The Test Is Not Reliable

Publisher Website
Google Scholar
Abstract
The present article responds to selected criticisms of some EPM editorial policies and Vacha-Haase's "reliability generalization" mete-analytic methods. However, the treatment is more broadly a manifesto regarding the nature of score reliability and what are reasonable expectations for psychometric reporting practices in substantive inquiries. The consequences of misunderstandings of score reliability are explored. It is suggested that paradigmatic misconceptions regarding psychometric issues feed into a spiral of presumptions that measurement training is unnecessary for doctoral students, which then in turn further reinforces misunderstandings of score integrity issues.