A Validity Study of Part III of the National Board Examination
- 1 June 1990
- journal article
- research article
- Published by SAGE Publications in Evaluation & the Health Professions
- Vol. 13 (2) , 227-240
- https://doi.org/10.1177/016327879001300206
Abstract
The purpose of this study was to investigate the validity of Part III of the National Board Examination, a certifying examination of medical knowledge and patient management abilities. The subjects were 1,866 first-year resident physicians who graduated from Jefferson Medical College between 1970 and 1984. Statistically significant correlations were found between scores on this examination on the one hand and measures of basic and clinical sciences in medical school and Parts I and II of the National Board Examination on the other hand. Also, graduates who were rated high on supervisors' ratings of clinical competence areas in residency obtained higher scores on the examination than those rated low on this scale even when their baseline knowledge (scores on Part II) was controlled by employing analysis of covariance. In addition, assumptions were made that graduates who were offered further residency training and those who pursued broader, less-specialized careers would score higher on this examination. Both assumptions were confirmed. This 15-year study not only provides unique information about the validity of one certifying examination, but it also presents a model that might be used to evaluate other certification tests. Improvements in validity produced by new testing methods, such as computerized administration, could be put into perspective by using similar validity studies.Keywords
This publication has 8 references indexed in Scilit:
- Components of Clinical Competence Ratings of Physicians: An Empirical ApproachEducational and Psychological Measurement, 1986
- The Validity of Credentialing ExaminationsEvaluation & the Health Professions, 1986
- Legal Trends Affecting the Validity of Credentialing ExaminationsEvaluation & the Health Professions, 1986
- Long-Range Predictive and Differential Validities of the Scholastic Aptitude Test in Medical SchoolEducational and Psychological Measurement, 1983
- The validity of licensure examinations.American Psychologist, 1982
- The Impact of Early Specialization on the Clinical Competence of ResidentsNew England Journal of Medicine, 1982
- Testing for licensure and certification.American Psychologist, 1981
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959