A methodological note on pitfalls in usability testing

Abstract
Although usability testing may be a well accepted and widely practised component of the commercial software development process, improper application of testing techniques may lead to poorly designed software. The present paper discusses a number of potential problems which designers may face in the process of conducting usability tests on their products. These problems may include difficulties in sampling, methodological problems in planning and conducting tests, validity and reliability of obtained measures, and misinterpretation of results. A number of suggestions to avoid or lessen the impact of these problems are also discussed.