Testing a Framework for Reliable Classification of Usability Problems
- 1 July 2000
- journal article
- Published by SAGE Publications in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Vol. 44 (37) , 573-576
- https://doi.org/10.1177/154193120004403707
Abstract
The User Action Framework (UAF) is a knowledge base of usability issues and concepts structured to provide a framework and method for classifying usability problems identified during usability evaluation. The UAF is essentially a hierarchical structure of usability attributes that users traverse as a decision structure, selecting the most appropriate classification category and sub-category at each level of the hierarchy. The cumulative set of category choices along the classification path is taken as a sequence of usability attributes that determines a complete classification description of the usability problem in question. The UAF itself has been the subject of usability evaluation and is the product of an extensive, iterative design process. In this paper we report on the reliability of the UAF by measuring the agreement of 10 experienced usability practitioners as they classify 15 different usability problems.This publication has 7 references indexed in Scilit:
- Enhancing the explanatory power of usability heuristicsPublished by Association for Computing Machinery (ACM) ,1994
- Comparing studies that compare usability assessment methodsPublished by Association for Computing Machinery (ACM) ,1993
- The Usability Engineering LifecyclePublished by Elsevier ,1993
- Heuristic evaluation of user interfacesPublished by Association for Computing Machinery (ACM) ,1990
- User Centered System DesignPublished by Taylor & Francis ,1986
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960