The Reliability of a Certain University Examination Compared with the Precision of Absolute Judgements
Open Access
- 1 May 1990
- journal article
- research article
- Published by SAGE Publications in The Quarterly Journal of Experimental Psychology Section A
- Vol. 42 (2) , 239-254
- https://doi.org/10.1080/14640749008401220
Abstract
A formula is proposed to estimate the reliability with which an examination assesses the individual merits of the candidates, using only the marks assigned naturally by the examiners. This formula, which is founded in classical test theory, can be applied (as here) to an examination in which the candidates are offered a wide choice of questions and different questions are marked by different pairs of examiners. The use of the formula is illustrated by reference to a certain university examination; and the results of analysing the correlations between marks independently awarded by different examiners are compared with previous studies of the reliability of university examinations, with similar studies of GCE examinations, and with the precision of absolute judgement of simple stimulus magnitudes.Keywords
This publication has 14 references indexed in Scilit:
- The relativity of ‘absolute’ judgementsBritish Journal of Mathematical and Statistical Psychology, 1984
- A FURTHER REPORT OF INVESTIGATIONS INTO THE RELIABILITY OF MARKING OF GCE EXAMINATIONSBritish Journal of Educational Psychology, 1982
- REMOVING THE MARKS FROM EXAMINATION SCRIPTS BEFORE RE‐MARKING THEM: DOES IT MAKE ANY DIFFERENCE?British Journal of Educational Psychology, 1979
- RELIABILITY OF MARKING IN EIGHT GCE EXAMINATIONSBritish Journal of Educational Psychology, 1978
- TOWARDS A STANDARDIZATION IN DEGREE CLASSIFICATIONAssessment in Higher Education, 1977
- Frequency discrimination as a function of frequency and sensation levelThe Journal of the Acoustical Society of America, 1977
- Context effects and the validity of loudness scales.Journal of Experimental Psychology, 1954
- The Information of Elementary Auditory DisplaysThe Journal of the Acoustical Society of America, 1952
- Reliability of repeated grading of essay type examinations.Journal of Educational Psychology, 1930
- The Central Tendency of JudgmentThe Journal of Philosophy, Psychology and Scientific Methods, 1910