Tool for accurately predicting website navigation problems, non-problems, problem severity, and effectiveness of repairs
- 2 April 2005
- proceedings article
- Published by Association for Computing Machinery (ACM)
Abstract
The Cognitive Walkthrough for the Web (CWW) is a partially automated usability evaluation method for identifying and repairing website navigation problems. Building on five earlier experiments [3,4], we first conducted two new experiments to create a sufficiently large dataset for multiple regression analysis. Then we devised automatable problem-identification rules and used multiple regression analysis on that large dataset to develop a new CWW formula for accurately predicting problem severity. We then conducted a third experiment to test the prediction formula and refined CWW against an independent dataset, resulting in full cross-validation of the formula. We conclude that CWW has high psychological validity, because CWW gives us (a) accurate measures of problem severity, (b) high success rates for repairs of identified problems (c) high hit rates and low false alarms for identifying problems, and (d) high rates of correct rejections and low rates of misses for identifying non-problems.Keywords
This publication has 18 references indexed in Scilit:
- Modeling Information Navigation: Implications for Information ArchitectureHuman–Computer Interaction, 2004
- Effects of scent and breadth on use of site-specific search on e-commerce Web sitesACM Transactions on Computer-Human Interaction, 2003
- The Evaluator Effect: A Chilling Fact About Usability Evaluation MethodsInternational Journal of Human–Computer Interaction, 2003
- Information foraging.Psychological Review, 1999
- Learning and Representing Verbal MeaningCurrent Directions in Psychological Science, 1998
- Damaged Merchandise? A Review of Experiments That Compare Usability Evaluation MethodsHuman–Computer Interaction, 1998
- Repairing Damaged Merchandise: A RejoinderHuman–Computer Interaction, 1998
- An introduction to latent semantic analysisDiscourse Processes, 1998
- A Comprehension-Based Model of ExplorationHuman–Computer Interaction, 1997
- A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge.Psychological Review, 1997