The Roles of Immediacy and Redundancy Relative Subjective Workload Assessment
- 1 September 1994
- journal article
- research article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 36 (3) , 503-513
- https://doi.org/10.1177/001872089403600307
Abstract
Subjective workload assessment is one of the most frequently used tools for system evaluation. However, little is known about which factors contribute to the sensitivity, validity, and reliability of subjective workload ratings. One major classification of subjective workload assessment tools is based on relative judgments of the workload of different task conditions. The present research evaluated different approaches to relative subjective workload assessment in terms of their sensitivity to demand manipulations, concurrent validity with performance, and test-retest reliability. Results indicated that performing relative judgments retrospectively after having experienced all task conditions was superior to rating each task condition immediately after performing it. Further, redundant relative comparisons may produce more sensitive ratings than do relative comparisons to a single reference task. Overall, the results support the use of retrospective relative workload judgments as an evaluation tool.Keywords
This publication has 15 references indexed in Scilit:
- Comparison of Four Subjective Workload Rating ScalesHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1992
- A FORTRAN 77 program for averaging correlation coefficientsBehavior Research Methods, Instruments & Computers, 1989
- The Use of Judgment Matrices in Subjective Workload Assessment: The Subjective Workload Dominance (SWORD) TechniqueProceedings of the Human Factors Society Annual Meeting, 1989
- Assessment of Crew Workload Measurement Methods, Techniques and Procedures. Volume 1. Process, Methods and ResultsPublished by Defense Technical Information Center (DTIC) ,1989
- The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental WorkloadPublished by Elsevier ,1988
- Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical ResearchPublished by Elsevier ,1988
- Time-Sharing Visual and Auditory Tracking TasksProceedings of the Human Factors Society Annual Meeting, 1987
- Evaluation of 16 Measures of Mental Workload using a Simulated Flight Task Emphasizing Mediational ActivityHuman Factors: The Journal of the Human Factors and Ergonomics Society, 1985
- On the Psychophysics of Workload: Why Bother with Subjective Measures?Human Factors: The Journal of the Human Factors and Ergonomics Society, 1984
- Computational procedures for estimating magnitude of effect for some analysis of variance designs.Psychological Bulletin, 1973