How Expert are “Expert” Wine Judges?
- 1 January 2009
- journal article
- research article
- Published by Cambridge University Press (CUP) in Journal of Wine Economics
- Vol. 4 (2) , 233-241
- https://doi.org/10.1017/s1931436100000821
Abstract
Recent papers by Hodgson (2008) and Gawel and Godden (2008) have questioned the consistency of expert wine judges in a wine competition setting. In the latter paper, a methodology introduced in psychometric research to measure judge reliability corrected for chance was used to quantify judge consistency (Cohen, 1968). This paper extends that notion, suggesting a value of 0.7 for Cohen's weighted kappa might be used to define an expert wine judge. With that criterion, less than 30% of judges who participated in either of the two studies would be considered “expert.” (JEL Classification: C1, L15)Keywords
This publication has 6 references indexed in Scilit:
- Evaluation of the consistency of wine quality assessments from expert wine tastersAustralian Journal of Grape and Wine Research, 2008
- An Examination of Judge Reliability at a major U.S. Wine CompetitionJournal of Wine Economics, 2008
- Who won the 1976 blind tasting of French Bordeaux and US Cabernets? Parametrics to the rescueJournal of Wine Research, 2004
- Analyzing a Wine Tasting StatisticallyCHANCE, 1999
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960