Overcoming Unreliability in Operational Measures: The Use of Surrogate Measure Systems

Publisher Website
Google Scholar
Abstract
Improved assessment of operational performance is critical for studies of selection, training and human engineering as well as those examining the performance effects of environmental changes, chemicals or other stressors imposed by military duties. The present discussion focuses on what we consider to be the major problem with such enterprises – the lack of sensitivity of operational measures because of poor reliability. The well-documented impact of low field measure reliability includes the inability to demonstrate differences resulting from experimental treatments and the chronic underrepresentation of validity in predictive studies. This paper describes a general methodology for using specially-developed performance batteries as surrogates for real-world performances, in particular for determining whether such performance may be disrupted by environmental or chemical agents. The logical and metric rationale of surrogate measurement is presented, and the advantages and disadvantages are discussed and compared to alternative approaches (job samples, synthetic tasks, etc.).

This publication has 9 references indexed in Scilit: