Assessing Teacher Performance from Observed Competency Indicators Defined by Classroom Teachers
- 1 March 1981
- journal article
- research article
- Published by Taylor & Francis in The Journal of Educational Research
- Vol. 74 (4) , 197-216
- https://doi.org/10.1080/00220671.1981.10885311
Abstract
This study was concerned with the measurement of a set of indicators of teacher competence, defined by the teachers themselves as observable in their classroom behavior. The question it sought to answer was whether scoring keys for existing low-inference observation schedules could be developed that would measure any or all of these indicators objectively and reliably. Multiple observations were made with four such instruments in 100 classrooms in a single rural school system to provide data relevant to the question. Forty-two scoring keys were developed to measure one or another of 26 indicators identified by the teachers and used to score the records made in the 100 classrooms. An analysis of variance was made of the scores on each key to estimate its reliability and to isolate and assess errors of measurement due to lack of internal consistency and to instability confounded with observer disagreement. It was concluded that keys could be constructed to yield stable and consistent measures of most indicators of competency from records made on at least one of the low-inference observation schedules used, even though they had been designed to measure other variables, but that some efforts to refine the keys, either by empirical analysis or by having the composition of the keys verified by the teachers who defined the indicators, was necessary to ensure that the scores obtained would reflect them accurately.Keywords
This publication has 5 references indexed in Scilit:
- Convergent and discriminant validity of five classroom observation systems: Testing a model.Journal of Educational Psychology, 1978
- Generalizability of Measures of Teaching BehaviorReview of Educational Research, 1976
- Classroom Observation Schemes: Where are the Errors?American Educational Research Journal, 1972
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959
- Coefficient alpha and the internal structure of testsPsychometrika, 1951