Measures of feeling‐of‐knowing accuracy: A new look at an old problem
- 1 August 1995
- journal article
- research article
- Published by Wiley in Applied Cognitive Psychology
- Vol. 9 (4) , 321-332
- https://doi.org/10.1002/acp.2350090405
Abstract
Two ordinal measures of feeling‐of‐knowing performance appropriate for n × n data arrays are reviewed. Goodman and Kruskal's gamma provides a measure of association between recognition performance and feeling‐of‐knowing judgements. The Hamann coefficient provides a measure of agreement accuracy. The relative strengths and weaknesses of each measure are compared at length. A proof is provided, which reveals a lack of one‐to‐one relation between the two and suggests that they may be independent under most circumstances. It is concluded that both measures should be reported together as complementary indices as each captures a different facet of feeling‐of‐knowing performance. Alternative measures for gamma and the Hamann coefficient are considered and a number of recommendations are made for future research.Keywords
This publication has 17 references indexed in Scilit:
- Voice matters in a dictator gameExperimental Economics, 2007
- On the evaluation of probability judgments: Calibration, resolution, and monotonicity.Psychological Bulletin, 1993
- The basis of test predictions for text material.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1992
- Increased processing enhances calibration of comprehension.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1990
- Response bias: Characteristics of detection theory, threshold theory, and "nonparametric" indexes.Psychological Bulletin, 1990
- Retrieval processes underlying confidence in comprehension judgments.Journal of Experimental Psychology: Learning, Memory, and Cognition, 1990
- Inexpert calibration of comprehensionMemory & Cognition, 1987
- Separability of metacognition and cognition: Problem solving in learning disabled and regular students.Journal of Educational Psychology, 1985
- Cluster Analysis for Researchers. By H. Charles Romesburg. (Belmont, Calif.: Lifetime Learning Publications, 1984. Pp. xiii + 334. $36.00.)American Political Science Review, 1984
- Measures of Association for Cross ClassificationsJournal of the American Statistical Association, 1954