Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough?
- 1 August 1992
- journal article
- research article
- Published by SAGE Publications in Human Factors: The Journal of the Human Factors and Ergonomics Society
- Vol. 34 (4) , 457-468
- https://doi.org/10.1177/001872089203400407
Abstract
Attention has been given to making user interface design and testing less costly so that it might be more easily incorporated into the product development life cycle. Three experiments are reported in this paper that relate the proportion of usability problems identified in an evaluation to the number of subjects participating in that study. The basic findings are that (a) 80% of the usability problems are detected with four or five subjects, (b) additional subjects are less and less likely to reveal new information, and (c) the most severe usability problems are likely to have been detected in the first few subjects. Ramifications for the practice of human factors are discussed as they relate to the type of usability test cycle employed and the goals of the usability test.Keywords
This publication has 7 references indexed in Scilit:
- User interface evaluation in the real worldPublished by Association for Computing Machinery (ACM) ,1991
- The Value of Thinking-Aloud Protocols in Industry: A Case Study at Microsoft CorporationProceedings of the Human Factors Society Annual Meeting, 1990
- Streamlining the Design Process: Running Fewer SubjectsProceedings of the Human Factors Society Annual Meeting, 1990
- Heuristic evaluation of user interfacesPublished by Association for Computing Machinery (ACM) ,1990
- What can you Learn from a Low-Fidelity Prototype?Proceedings of the Human Factors Society Annual Meeting, 1989
- Guidelines for the Use of a Prototype in User Interface DesignProceedings of the Human Factors Society Annual Meeting, 1988
- Computer-Intensive Methods in StatisticsScientific American, 1983