A comparison of the four prominent user-based methods for evaluating the usability of computer software
- 1 October 1995
- journal article
- research article
- Published by Taylor & Francis in Ergonomics
- Vol. 38 (10) , 2030-2044
- https://doi.org/10.1080/00140139508925248
Abstract
The aim was to examine four prominent user-based computer software usability evaluation methods. Four evaluation methods (logged data, questionnaire, inter view, and verbal protocol analysis) were used to evaluate three different business software types (spreadsheet, word processor, and database) using a between-groups design, involving 148 individuals of mixed age and gender. Comparisons were made to examine the efficiency of each evaluation method in terms of its ability to highlight usability problems both between and within the evaluation strategy. Here, the verbal protocol analysis was found to be most efficient. The possibility of further efficiency gains by using two evaluation methods was also examined, where it was found that no statistically significant improvement was obtained over the verbal protocol analysis used by itself. Ways in which the utility of the methods may be enhanced was also discussed.Keywords
This publication has 15 references indexed in Scilit:
- Designing and using integrated data collection and analysis tools: challenges and considerationsBehaviour & Information Technology, 1994
- The usability engineering laboratories at Sun MicrosystemsBehaviour & Information Technology, 1994
- Heuristic evaluation of user interfacesPublished by Association for Computing Machinery (ACM) ,1990
- Towards a practical method of user interface evaluationApplied Ergonomics, 1989
- We can design better user interfaces: A review of human-computer interaction stylesErgonomics, 1988
- Cost/benefit analysis for incorporating human factors in the software lifecycleCommunications of the ACM, 1988
- Human-Computer Interface RecordingThe Computer Journal, 1988
- The use of menus in the design of on-line sytemsACM SIGCHI Bulletin, 1985
- Designing for usability: key principles and what designers thinkCommunications of the ACM, 1985
- Evaluation of different modalities of verbalization in a sorting taskInternational Journal of Man-Machine Studies, 1983